-- Logs begin at Mon 2022-06-20 05:13:49 UTC, end at Mon 2022-06-20 07:01:57 UTC. -- Jun 20 05:56:42.493631 dv-cinder-804735-31-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 05:56:42.502112 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 05:56:42 2022] *** Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: nodename: dv-cinder-804735-31-iscsi Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: machine: x86_64 Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: clock source: unix Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: pcre jit disabled Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: detected number of CPU cores: 4 Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: current working directory: / Jun 20 05:56:42.504117 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: detected binary path: /usr/bin/uwsgi-core Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: your processes number limit is 47680 Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: your memory page size is 4096 bytes Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: detected max file descriptor number: 2048 Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: lock engine: pthread robust mutexes Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: thunder lock: enabled Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 05:56:42.504668 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 05:56:42.549456 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: Python main interpreter initialized at 0x55ef76a589c0 Jun 20 05:56:42.549456 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: python threads support enabled Jun 20 05:56:42.549456 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: your server socket listen backlog is limited to 100 connections Jun 20 05:56:42.549456 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: your mercy for graceful operations on workers is 90 seconds Jun 20 05:56:42.549791 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 05:56:42.549887 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: *** Operational MODE: preforking *** Jun 20 05:56:42.550157 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: *** uWSGI is running in multiple interpreter mode *** Jun 20 05:56:42.550157 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: spawned uWSGI master process (pid: 80374) Jun 20 05:56:42.550354 dv-cinder-804735-31-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 20 05:56:42.551708 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 1 (pid: 80385, cores: 1) Jun 20 05:56:42.551708 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 2 (pid: 80386, cores: 1) Jun 20 05:56:42.551708 dv-cinder-804735-31-iscsi devstack@keystone.service[80374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 05:56:48.043594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:48.043594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes Jun 20 05:56:48.044384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:48.044384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes Jun 20 05:56:48.092760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:56:48.092956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:56:48.093151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] command line args: [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:56:48.093455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:56:48.093632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ================================================================================ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:56:48.093888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.094138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_dir = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.094345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.094517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_source = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.094698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] debug = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.094899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.095269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.095451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.095705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.095956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.096206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.096378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_config_append = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.096550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.096723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_dir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.096897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.097128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.097415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.097654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.097904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.098106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.098262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.098514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.098764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.099002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.099235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.099470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.099706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.099958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.100218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.100486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.100964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.101140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] publish_errors = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.101368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.101630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.101812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.102062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.102302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.103052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] standard_threads = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.103296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.103548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.103809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.103992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_journal = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.104173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_json = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.104373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_stderr = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.104528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_syslog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.104767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.105024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.105266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.105554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.105798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.106049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.106292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.106542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.106781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.107031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.107280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.107531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.107766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.108017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.108258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.108507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.108755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.108999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.109254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.109532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.109781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.110021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.110276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.110541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.110796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.111045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.111279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.111513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.111746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.111983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.112231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.112481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.112714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.112946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.113195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.113471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.113712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.113963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.114195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.114431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.114667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.114898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.115130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.115365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.115599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.115839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.116090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.116324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.116564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.116797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.117034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.117273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.117543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.117777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.118017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.118896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.119139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.119381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.119620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.119855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.120109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.120347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.120586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.120820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.121080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.121319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.121578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.121819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.122059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.122327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.122567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.122818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.123062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.123301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.123539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.123776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.124024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.124265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.124506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.124748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.124987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.125227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.125494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.125736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.125976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.126240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.126482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.126725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.126966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.127210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.127449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.127688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.127926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.128161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.128394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.128626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.128869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.129101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.129343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.129602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.129852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.130090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.130348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.130607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.130850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.131085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.external = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.131318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.131614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.131849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.132083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.password = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.132317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.token = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.132557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.132794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.133042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.133274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.133544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.133844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.134085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.134325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.134575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.134827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.135077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.135317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.135565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.135804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.136074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.136329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.136569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.136824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.137107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.137354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.137647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.137899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.138161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.138402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.138644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.138909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.139162 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.139396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.139647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.139887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.140145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.140386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.140644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.140886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.141137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.141400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.141646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.141896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.142136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.142375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.142691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.142855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.143095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.143425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.143623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.143818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.144050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.144281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.144528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.144777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.145025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.145283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.145554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.145848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.146075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.146314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.146547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.146786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.147014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.147504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.147746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.148006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.148237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.148470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.148719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.148969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.149204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.149561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.149851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.150087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.150328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.150561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.150801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.151038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.151278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.151516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.151755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.152004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.152255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.152505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.152716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.152966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.153224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.153487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.153742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.153968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.154201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.154441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.154700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.154934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.155181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.155429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.155675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.155912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.156144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.156381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.156617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.156853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.157085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.157332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.157602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.157847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.158095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.158345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.158584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.158839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.159078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.159316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.159553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.159790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.160037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.160285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.160524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.160780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.161011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.161254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.161513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.161752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.161990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.162237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.162477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.162712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.162948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.163188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.163437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.163688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.163924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.164173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.164424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.164661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.164909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.165785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.166035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.166276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.166528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.166762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.167012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.167262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.167511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.167760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.168007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.168253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.168499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.168748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.168983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.169235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.169510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.169761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.170008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.170407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.170645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.170895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.171146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.171393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.171643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.171880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.172138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.172394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.172636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.172870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.173104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.173337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.173612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.173870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.174119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.174360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.174598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.174830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.175068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.175309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.175557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.175673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:48.175673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes Jun 20 05:56:48.176235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.176351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:48.176351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes Jun 20 05:56:48.176568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.176568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.176568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.176878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.176990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.177195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.177463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.177704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.177940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.178186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.178435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.178666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.178910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.179209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.179476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.179726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.179976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.180216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.180466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.181333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.181722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.181973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.182216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.182468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.182711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.182960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.183200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.183453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.183693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.183941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.184174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.184417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.184655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.184828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:56:48.215244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.215468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.215695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.222835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:56:48.223049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:56:48.223248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] command line args: [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:56:48.223526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:56:48.223707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ================================================================================ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:56:48.223971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.224179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.224262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_dir = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.224399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.224587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] config_source = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.224772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] debug = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.224991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.225244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.225461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.225730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.225984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.226219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.226402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_config_append = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.226585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.226767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_dir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.226948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.227187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.227437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.228278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.228591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.228715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.228895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.229143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.229400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.229652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.229888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.230125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.230361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.230612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.230861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.231138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.231634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.231820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] publish_errors = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.232057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.232289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.232470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.232718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.232957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.233193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] standard_threads = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.233449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.233698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.233878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.234062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_journal = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.234243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_json = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.234422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_stderr = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.234600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] use_syslog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.234833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:48.235094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.235338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.235602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.235845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.236099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.236343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.236596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.236839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.237092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.237346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.237635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.237876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.238131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.238373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.238625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.238878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.239122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.239382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.239641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.239893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.240134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.240393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.240662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.240920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.241176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.241435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.241675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.241910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.242152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.242407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.242660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.242896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.243158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.243997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.244355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.244611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.244870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.245108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.245350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.245616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.245853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.246088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.246324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.246559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.246802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.247057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.247293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.247535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.247771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.248012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.248255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.248508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.248744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.248987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.249237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.249504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.249751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.249993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.250229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.250485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.250729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.250974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.251214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.251479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.251720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.251957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.252356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.252479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.252703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.252848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.252969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.253082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.253196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.253442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.253686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.253932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.254174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.254426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.254668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.254909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.255158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.255400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.255641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.255880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.256121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.256361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.256625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.256868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.257113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.257358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.257626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.257868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.258111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.258352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.258590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.258867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.259114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.259349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.259584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.259829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.260071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.260324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.260568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.260831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.261093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.261341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.261602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.external = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.261839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.262140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.262385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.262624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.password = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.262860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.token = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.263104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.263347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.263599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.263846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.264100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.264354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.264590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.264832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.265086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.265342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.265622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.265865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.266114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.266353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.266621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.266880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.267121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.267378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.267668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.267921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.268190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.268437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.268698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.268996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.269183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.269458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.269715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.270009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.270483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.270946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.271444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.271876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.272393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.272647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.272908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.273154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.273432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.273693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.273945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.274189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.274525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.274834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.275085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.275424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.275697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.275937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.276175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.276496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.276973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.277496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.277981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.278483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.278971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.279301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.279557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.279808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.280050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.280306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.280546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.280792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.281043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.281291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.281573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.281811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.282066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.282321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.282564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.282824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.283078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.283316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.283561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.283802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.284047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.284290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.284538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.284779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.285022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.285277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.285557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.285797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.286035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.286291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.286544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.286785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.287025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.287267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.287504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.287750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.288015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.288251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.288506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.288759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.289013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.289254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.289522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.289767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.290508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.290953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.291203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.291461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.291717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.291972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.292225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.292477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.292714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.292968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.293211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.293476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.293766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.293965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.294220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.294486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.294734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.294996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.295232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.295482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.295724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.295965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.296208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.296459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.296707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.296943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.297187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.297459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.297718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.297974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.298218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.298473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.298732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.298976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.299229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.299474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.299720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.299961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.300215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.300450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.300707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.300963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.301218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.301497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.301752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.302005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.302257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.302510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.302750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.303002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.303256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.303509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.303760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.304227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.304481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.304744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.305004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.305264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.305550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.306392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.306670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.306936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.307186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.307428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.307668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.307909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.308171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.308438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.308699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.309491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.309491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.309491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.309784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.309919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.310175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.310421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.310687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.310942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.311188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.311441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.311693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.314064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.315834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.316031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.316280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.316523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.316771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.317013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.317267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.317546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.317798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.318035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.318282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.318523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:48.318698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:56:48.346288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.346524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.346757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.356599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.376010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.376223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.392134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.443265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.443503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.499315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.512195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.512429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.512655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.512877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.513098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.513316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.534858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.535100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.538298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.538536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.538766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.538990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.539212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.539431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.539650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.550740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.563847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.564084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.564316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.564543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.564764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.564983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.565201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.577485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.577724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.577954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.578182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.578406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.578628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.582813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.583028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:48.583367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.583572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:48.583846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.584109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.584369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.584626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.593626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.593874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.594108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.594338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.594560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.594780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.594999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.595437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.595716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.595987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.596266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.602817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.604580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.605836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.606074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.606302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.606525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.606744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.606960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.607181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:48.607878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.608160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.608442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.608724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.609024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.609268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.609566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.609841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.610112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.610386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.610653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.617701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.617914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:48.618883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.619093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:48.619366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.619625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.619883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.620153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.631241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.631520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.631812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.632107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.637827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.639434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.639718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.640303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.643668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.643961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.644255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.644639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.644929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.645007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.645197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.645338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.645502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.645647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.645793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.646079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.646367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.646648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.653702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.653985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.658469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.658758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.659042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.659326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.659605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.659880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.660150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.660417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.674411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.676039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.676322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.679074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.679355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.682197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.682480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.682768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.684634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.688250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.688651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.690126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.690412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.693706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.695091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.695389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.695674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.695958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.696237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.696765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.697227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.697436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.697524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.703864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.717009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.717301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.721921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.722012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.722264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.722529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.722801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.725579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.725875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.731297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.731626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.732983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.733261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.735375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.736462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.736746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.737029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.737345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.737708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.739044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.739347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.739636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.739920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.740198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.740477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.751129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.751410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.751701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.751985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.753639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.753938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.754228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.760388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.760670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.760939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.761212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.769086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.770816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.771097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.772798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.775000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.775296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.775564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.775846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.776130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.776746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.780058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.781808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.783456 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.783736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.784031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.789518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.789803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.790126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.790413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.790691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.790967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.791245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.791524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.793131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.796389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.796680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.797074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.797353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.806525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.806765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.807046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.810351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.813656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.814877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.815158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.815439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.815717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.815992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.816379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.816666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.816939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.817019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.817213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.817521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.817795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.818059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.818327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.818571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.818651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.820206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.820489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.820777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.828781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.830578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.833812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.834114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.834405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.834688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.843925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.844226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.844519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.852375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:48.853184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.853486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.853768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.854044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.854317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.854611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.854886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.855168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.855458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.855732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.855996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.856369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.856648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:48.857608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef76a589c0 pid: 80385 (default app) Jun 20 05:56:48.861124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266b1a-bb79-4956-8f44-88c8a9ee12fa None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:48.861440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266b1a-bb79-4956-8f44-88c8a9ee12fa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:48.861726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266b1a-bb79-4956-8f44-88c8a9ee12fa None None] PATH_INFO: `/v3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:48.866635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Jun 20 05:56:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:48.895452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef76a589c0 pid: 80386 (default app) Jun 20 05:56:56.531574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:56.532137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:56.532137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:56.533494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:56:56.541758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:56.542211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:56.542303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:56.611430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: INFO dbcounter [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] Registered counter for database keystone Jun 20 05:56:56.636418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG oslo_db.sqlalchemy.engines [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:56:56.642795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writer thread running {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:56:56.819451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:56:56.819872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:56:56.874763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:56.876286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:56.998214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:56:57.155841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:57.225597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: INFO dbcounter [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] Registered counter for database keystone Jun 20 05:56:57.245488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG oslo_db.sqlalchemy.engines [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:56:57.251610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writer thread running {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:56:57.369620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6b13-2407-4020-ae7f-1c11cb8fdc37 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:57.373874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:57.374531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:57.374811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:57.375108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:57.383100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:57.435223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:56:57.435507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bf2e4-5209-46e0-8c37-68994a19b158 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:57.445656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jun 20 05:56:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:56:57.452299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:57.466638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b6bc-d534-4e29-9663-92cc70fc97cc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:57.471087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:57.472210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:57.472498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:57.472775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] PATH_INFO: `/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:57.476876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f9a6bdb9ae7447fb41cd2764e1194d4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:57.527909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:56:57.528254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df74e00-a98c-42c1-85c0-a0acf7da3032 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:57.532786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Jun 20 05:56:57 2022] GET /identity/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:56:59.797819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2378ba-4dcd-4f62-b8f1-9f7eea54cff0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:59.798340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2378ba-4dcd-4f62-b8f1-9f7eea54cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:59.798340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2378ba-4dcd-4f62-b8f1-9f7eea54cff0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:59.802463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:56:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:59.808130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:59.808542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:59.808690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:59.827126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:59.828644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:59.836394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:56:59.859006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2378ba-4dcd-4f62-b8f1-9f7eea54cff0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:59.871901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2378ba-4dcd-4f62-b8f1-9f7eea54cff0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:59.876074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:59.876708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:59.876993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:59.877274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:59.886297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:59.888104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49c2fe-412b-4d51-aba5-9afa6595c068 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:59.896855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jun 20 05:56:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:56:59.902882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:59.911863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc852b7e-2b89-4e87-a9fc-e5202745b7af None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:59.916278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:59.917134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:59.917443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:59.917722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:59.919105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:59.920928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999664b-dbfa-445b-aa3a-0b89c3f55199 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:59.922529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Jun 20 05:56:59 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:02.017179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e0a7-dd8f-4ee2-be35-1cf38286fc51 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.017747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e0a7-dd8f-4ee2-be35-1cf38286fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.017747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e0a7-dd8f-4ee2-be35-1cf38286fc51 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.019122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:02.024590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.025099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.025308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.041873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:02.043066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:02.046745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4ec-f0ab-472f-84fe-42caa659c343 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.047046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4ec-f0ab-472f-84fe-42caa659c343 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.047332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4ec-f0ab-472f-84fe-42caa659c343 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.048683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:02.053973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.054268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.054549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.095835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:57:02.096259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:57:02.125455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:02.142352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:02.143963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:02.148982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.172364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.247823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:02.256252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2380d-1830-46ca-ac84-50ba0150abc5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.271083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.292183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.292993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.293289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.304719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:02.316038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:02.316999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:02.318025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 6/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:02.323507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.373969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db621-118a-4fb6-aa26-bd2e6fc25cc4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.376295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.408456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.412249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.413153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.413472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.413757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.429647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908424-f000-4c16-8410-9b33eb23f89a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.465308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.466011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.466302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.466584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.467340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:02.467658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.469079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.480972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 7/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:02.481983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.483583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.487092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.586294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:02.590434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770ab9-f2b0-4388-a7a9-00d1b26b71c2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.592482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.595603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.626987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.627855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.628138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.628509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.629653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.631142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.632760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:02.638141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.653138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.699154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a4f9-28f4-4bc4-b791-1a7254367316 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.739447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.740236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.740524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.740803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.748284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c15830-9e0b-40a6-85d2-9ea460612ff5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.759589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.761081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:02.784802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:02.785824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:02.786834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:02.786834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:02.786834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:02.786834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:02.788281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:02.790751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.791947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.792235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.792515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.794465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.795257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.796764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.798453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:02.803961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:02.853771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.885999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:02.901168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711e92-c702-4bd3-8b89-0bbe4d9bacfe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.907448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a78b-9009-406c-86f2-60ac0d52b116 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:02.935607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.936276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.936561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.937090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.937591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:02.937900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.939304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e658902-f680-4128-a740-03c6d65903a1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.941604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:02.942256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:02.942541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:02.942821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:02.943652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.domain.id=default, user.id=3192aad0e5c64158b978fa55eb9121d5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:02.943962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:02.945419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d92bd-e2a1-4810-a558-ab36cd260740 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:02.952968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/role_assignments?user.id=3192aad0e5c64158b978fa55eb9121d5&scope.domain.id=default&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:02.956903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:05.221007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569a76-e955-48d1-a545-c5b772bcb87c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.222062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569a76-e955-48d1-a545-c5b772bcb87c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.222584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569a76-e955-48d1-a545-c5b772bcb87c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.224164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:05.229794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.230215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.230404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.254506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:05.255704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:05.355470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:05.389745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569a76-e955-48d1-a545-c5b772bcb87c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:05.514523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569a76-e955-48d1-a545-c5b772bcb87c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:05.554428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:05.555230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.555623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.555623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.570803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-812b53e0-f0db-4222-8f32-43cd6558626c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:05.583264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:05.584088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:05.585260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 12/24] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:05.590715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:05.616640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e40a1-139e-4c78-b033-caaaa368c978 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.616960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e40a1-139e-4c78-b033-caaaa368c978 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.617212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e40a1-139e-4c78-b033-caaaa368c978 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.620317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:05.626017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.626308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.626598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.633424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:05.644799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:05.646343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:05.678477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:05.721588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:05.761613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:05.784654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294236-23e0-4422-b481-1707a7889ee0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:05.882102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:05.882802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.883090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.883373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.884778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:05.885095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:05.886530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9e96e-7869-4ba0-a9ef-c7270b2b78e6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:05.898004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceda164-093b-433b-bd64-93f41ff45223 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:05.915739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 13/27] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:05.917276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aec8a-bf4d-42a2-acc0-de07c0f94abd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.917488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aec8a-bf4d-42a2-acc0-de07c0f94abd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.917642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aec8a-bf4d-42a2-acc0-de07c0f94abd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.919196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:05.921733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a86-50b5-4f76-a2e6-71cb0913a5b6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.922256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a86-50b5-4f76-a2e6-71cb0913a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.922741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a86-50b5-4f76-a2e6-71cb0913a5b6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.924468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 15/29] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:05.925978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.926472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.926937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.936830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:05.937742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.938159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.938442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.948759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:05.949717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:05.950445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:05.951245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:05.954099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c04b547c-97de-4570-96ff-a850af80e694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:05.973286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:05.974216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:05.975093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:05.975093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:05.975093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:05.975093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:05.975093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:05.976127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:05.976127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:05.976412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:05.996440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:05.997784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:06.033394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 16/31] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:06.034786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.076958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:06.077647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.082745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:06.153073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbfd4f-8239-4891-8dbd-b4b714d65407 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.188679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.189556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bf547-8a38-4b24-98a4-27ceb66af0f5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.190118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.190611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.191183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.193562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.195227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.198071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:06 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:06.202470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.207472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:06.228291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.229252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.229589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.229876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.230613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:06.230938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.232492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.251873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:06.252932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.314254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf222a77-e79b-4c39-8499-b6c06111c076 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.322339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:06.352032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.352615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.352983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.353274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.354274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.355629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.378802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926fbc-8798-449a-b8ba-222b361abc37 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.414809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.415846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.416312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.416769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.417735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.419396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.485875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:06 2022] POST /identity/v3/roles => generated 219 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:06.487001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.551182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:06 2022] POST /identity/v3/roles => generated 225 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:06.552576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.597919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:06.679359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d968d2-faec-439c-b6e5-2fb5e846d0c2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.716559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8aa9e-4d28-4304-9636-b8ccd03e20d9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.721766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.722758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.723230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.723721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.724638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.726497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.761506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:06 2022] POST /identity/v3/projects => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:06.787444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.788737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.789218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.789798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.791546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.793441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd756f93-de60-4ddf-a694-b5fd1eb2e0e6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.795433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:06.802656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:07.020020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:07.038567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e614e-9bf2-4fb1-9479-2409c1f56b7c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:07.078887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:07.079874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.080167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.080456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] PATH_INFO: `/v3/domains/default/users/3192aad0e5c64158b978fa55eb9121d5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.082562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3192aad0e5c64158b978fa55eb9121d5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:07.084057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0027b8e-a940-4627-af28-2cd49b6859eb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:07.103539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 20/39] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Jun 20 05:57:06 2022] PUT /identity/v3/domains/default/users/3192aad0e5c64158b978fa55eb9121d5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:07.178292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302d728-ff62-4a81-961b-6b4711adc00b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.178586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302d728-ff62-4a81-961b-6b4711adc00b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.179041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302d728-ff62-4a81-961b-6b4711adc00b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.180977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:07.186981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.187267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.187553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.206552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:07.208088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:07.259555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822429b-1cc6-49fd-8c25-6ecd652ceb6c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.259916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822429b-1cc6-49fd-8c25-6ecd652ceb6c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.260216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822429b-1cc6-49fd-8c25-6ecd652ceb6c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.261644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 21/41] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:07.266788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.267085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.267373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.285609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:07.287058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:07.289271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:07.312482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:07.323677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:07.372413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:07.396081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:07.402092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:07.427873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b76d1-a428-47b6-bdba-0dbc586b358a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:07.464486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:07.465278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.465595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.466010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.466766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:07.468177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:07.483641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:07 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:07.502894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b1f2-6483-4658-b184-8612bdd8cfd2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:07.543346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:07.544065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.544345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.544627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.545920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:07.547410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088175-2bad-4710-9aa2-89ed08898dbe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:07.549263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:07.554789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:07.668946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8ffa-9493-45ec-8af3-abfa8c7c0999 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:07.704309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:07.704972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:07.705260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:07.705570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:07.706292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:07.707761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ad59-f9ce-4dc5-af1f-7f3e6ee03185 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:07.716358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:07.733988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:07 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:09.156091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21dafa-ad10-4045-ae83-081c5f17151d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.156605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21dafa-ad10-4045-ae83-081c5f17151d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.156687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21dafa-ad10-4045-ae83-081c5f17151d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.158366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:09.163358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.163733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.164081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.183321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:09.184525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:09.250208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:09.273571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21dafa-ad10-4045-ae83-081c5f17151d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.304210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.380181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21dafa-ad10-4045-ae83-081c5f17151d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.421990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.422707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.422993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.423271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.435225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:09.443947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:09.444905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:09.445791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:09.452505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.553582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55978-e53c-43a9-9fab-8bff6930df0e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.574103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.589367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.590057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.590345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.590627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.591402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:09.591713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.593136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.601118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:09.607222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.699357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.708915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344efb-ad45-4c61-8f3c-a09c7d0dca26 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.743697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.744566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.744859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.745138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.749996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.752762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d490-0bf9-4199-9da1-0a5582b5d457 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.755434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:09.761801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.798379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a979aa-3350-4524-b5a0-2ad1f3c21a65 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.798672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a979aa-3350-4524-b5a0-2ad1f3c21a65 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.798954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a979aa-3350-4524-b5a0-2ad1f3c21a65 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.800329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 27/52] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:09.805265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.805599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.805892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.824234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:09.825501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:09.863736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cdab-080e-42c4-a7a9-cd60d7c140ab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.899726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.900619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.900900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.901171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.902454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.903946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.905690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:09.911657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.964673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.996770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 28/54] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:10.015894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dfe24-68f4-4c2f-a619-b6e2d07bf111 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:10.027517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:10.053222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:10.053906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:10.054201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:10.054485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:10.056099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.domain.id=default, user.id=3192aad0e5c64158b978fa55eb9121d5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:10.056812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:10.058328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:10.064105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/role_assignments?user.id=3192aad0e5c64158b978fa55eb9121d5&scope.domain.id=default&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:10.125397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:10.135838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950766-3e0d-429a-bff4-b3a74fe5012f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:10.172338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:10.173154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:10.173470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:10.173755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:10.174996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:10.176500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4701ea-695d-4863-aef3-b80a6edb3601 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:10.178224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:10.184516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:10.292437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ff1a-5054-42be-9e51-6dbc20c88fa6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:10.306152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:10.326246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:10.326939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:10.327230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:10.327515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:10.328230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:10.329722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b331cf-60da-4b61-8eb6-7e316178f57b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:10.354956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jun 20 05:57:10 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:12.427241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24969-fc60-4eb3-882c-33c53d7d2311 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.427713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24969-fc60-4eb3-882c-33c53d7d2311 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.427822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24969-fc60-4eb3-882c-33c53d7d2311 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.429169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:12.434864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.435233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.435419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.452302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:12.453497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:12.517026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:12.542148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb24969-fc60-4eb3-882c-33c53d7d2311 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.641759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb24969-fc60-4eb3-882c-33c53d7d2311 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.674405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.675192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.675478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.675760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.676942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.678424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dca3d-2f0e-4f96-88e2-b2b3ce83bde5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.680037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:12.685902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.775970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.782109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f363931-1d07-4c33-a4e7-b2ecde8118d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.816709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.817386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.817682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.817956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.818655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.820111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab01f-908b-453e-b848-f7dc038a0bed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.844476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:16.014389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5a14-bb32-4ae1-9280-1db07d2e9486 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.014921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5a14-bb32-4ae1-9280-1db07d2e9486 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.014997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5a14-bb32-4ae1-9280-1db07d2e9486 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.016329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:16.021571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.022397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.023168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.049437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:16.050998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:16.157256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4281f-e754-487f-9571-6d9800fc5179 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.157256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4281f-e754-487f-9571-6d9800fc5179 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.157256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4281f-e754-487f-9571-6d9800fc5179 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.157256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 33/63] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:16.162689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:16.163963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4957d-9884-4b91-b597-21d26bc77a9d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.164425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4957d-9884-4b91-b597-21d26bc77a9d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.165535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4957d-9884-4b91-b597-21d26bc77a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.187608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.201009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4fd4957d-9884-4b91-b597-21d26bc77a9d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:16.202222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4fd4957d-9884-4b91-b597-21d26bc77a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:16.232210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.304965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.329839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:16.330804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a85f-dae3-4b2d-b39d-5903c3d92cc9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.331555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a85f-dae3-4b2d-b39d-5903c3d92cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.331990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a85f-dae3-4b2d-b39d-5903c3d92cc9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.333473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 35/66] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:16.333867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9ebe-a490-4068-b86f-ad96b7877c45 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.334682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651d75-507a-46f5-8f77-fcb016452aae None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.334976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651d75-507a-46f5-8f77-fcb016452aae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.335260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651d75-507a-46f5-8f77-fcb016452aae None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.338019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 36/67] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:16.342195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.342695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.343184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.362249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:16.363450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:16.381493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.382893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.383472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.383986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.397280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-511c4383-4d38-4b04-ad55-069a257756e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:16.408525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:16.409293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 32/68] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:16.415470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.415470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.415470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.431400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:16.432602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:16.440474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:16.445552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.516617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:16.517613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.548271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.569174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5353-c78d-462a-a78b-7823d0b56b81 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.598875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.611266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.612438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.612874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.613161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.625074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:16.631429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eb335-a947-435c-a6f7-88a449a1118f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:16.632873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:16.633850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:16.634607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:16.635176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:16.635620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.678434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.679115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.679407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.680185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.681462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:16.682142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.684158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.694712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.696259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.752371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ae95f-f537-450c-a67f-ff58c5f61c06 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.788539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.789417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.790246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.790532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.800618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:16.804968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7127f51-06a6-433b-becc-a63f073f42aa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:16.808943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:16.809808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:16.810725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:16.812773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.822473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.838791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.839584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.839870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.840152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.842046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.851259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:16.859543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:16.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:16.861140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:16.865615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:16.866270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.912407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a078ba-cf89-4db5-b3d7-7ec7948093bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.945771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.946614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.946904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.947187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.947952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:16.948264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.949693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef2d7-90c3-4481-9e99-bf8dd77aa14e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.957754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 40/75] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.958963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b7e-4f75-4678-96f3-b45ab4531047 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.959252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b7e-4f75-4678-96f3-b45ab4531047 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.959533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203b7e-4f75-4678-96f3-b45ab4531047 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.960774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 41/76] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:16.962235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203b7e-4f75-4678-96f3-b45ab4531047 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.970202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebda38-84b1-42a3-a982-6be2540a31c0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.003872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.004747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.005037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.005317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.018908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.020392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.022163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 36/77] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.023284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.032989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.068497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203b7e-4f75-4678-96f3-b45ab4531047 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.077293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.101581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.102856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.103146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.103422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.104172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:17.104480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.105887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.113855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 42/78] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.114634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.129403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea947c88-fa39-4a69-b2c8-d5a712fb465e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.163590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.164250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.165130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.165409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.166144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:17.166456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.167839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be4cb-e900-44c6-a11d-fd891915b5e3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.175616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 37/79] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.176909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.177207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.177517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.193072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:17.194294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:17.215763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db793d9-e78e-4181-9111-fd547e31f1f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.244610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.250750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.251615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.251904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.252185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.253421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.254901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.256551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 43/80] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.257311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.260929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 38/81] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:17.262126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.307402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.363517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7d38d-e60c-4090-b763-4090b8ef1fe2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.366460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c30d1e-e67b-4518-8f95-1ceec7f59509 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.396424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.397291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.397852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.398129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.399380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.399724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.400368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.400652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.400883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.400966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.402554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 39/82] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.403308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.468658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.472400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.473912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.499555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc159e33-7f78-4dc8-8e4d-08f9743a47e2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.512358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.534198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.535072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.535359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.535644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.536856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.538383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.540685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 40/83] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.541492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.579909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 44/84] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:17.581049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.642916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1cce-364a-47f9-a822-52d623f7928b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.673344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.677704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583a30f-aba2-4933-ac3a-ac88183d6209 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.678735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.679389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.679678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.679954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.711173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.712495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.712779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.713057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.714272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.715725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.717339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 45/85] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:17.718119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.732120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.752245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.753780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.824162 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac186-13c2-478a-b032-e1b24ac4635c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.855607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 41/86] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:17.856178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:17.858625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.859283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.859569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.859937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:17.893223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.928507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:17.930019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:17.935720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:17.956140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c547-d835-4b6d-a5b9-b26f0841d766 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:17.989130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:17.989808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:17.990097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:17.990383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.030029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:18.032290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.058183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.059675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.097491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.131018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6283cc-d637-402d-83af-59981cdbcb73 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.138696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.159896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:18.160692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.166214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.167076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.167361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.167642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.168838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.170324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.172018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 47/89] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.172777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.262817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08691-326f-40e4-b64d-9ba99b4a2bd3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.272093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462be6-1452-4d2c-9c50-a497c6846f1f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.296656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.297327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.297646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.297931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.298656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.300134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.306746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.307597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.307876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.308152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.309369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.312355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.313217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 48/90] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.314322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.317201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.333411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 43/91] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:18 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:18.333411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.370993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.442015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3e2f-e503-4268-bec4-240a70042de0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.454165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97289ac5-77a6-4843-b15a-4696e4e0abe7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.480563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.481462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.481748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.482028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] PATH_INFO: `/v3/projects/4eebee43adbf4618a49f489e06f2db5d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.483282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=4eebee43adbf4618a49f489e06f2db5d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.484742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.491239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 49/92] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/projects/4eebee43adbf4618a49f489e06f2db5d => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.491239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.498084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.499453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.499738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.500016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.502828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.505345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.507320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 44/93] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.507320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.579276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.625120 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce789733-1636-45a8-8b8d-73d314d1b2d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.645411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431c2d-1185-467a-8eb5-80d6350c8d0c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.649015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:18.669197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.669888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.670172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.670455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.671292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:18.671599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.673037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.682445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 50/94] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.683365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.692780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.693828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.694283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.694723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.695802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:18.696832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.698604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.706165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 45/95] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=304a10ad50ff4fad86a065396035066f => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.707350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:18.827352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52bfa5-b3fa-4cd8-b531-91601ce99b61 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:18.868562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:18.869698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.870187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.870661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.871726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=3192aad0e5c64158b978fa55eb9121d5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:18.872280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:18.874072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab86f4-4550-48c7-8dea-1249f6cf436b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:18.881169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/role_assignments?user.id=3192aad0e5c64158b978fa55eb9121d5&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:18.962741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856f9b-dc39-4b0f-89b0-84e852c4bb2d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:19.002194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:19.002863 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:19.003151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:19.003434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:19.004287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=4eebee43adbf4618a49f489e06f2db5d, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:19.004603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:19.006129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f36b4-d031-41c1-b66d-acdb7dcb0b25 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:19.008704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:19.019869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:18 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=4eebee43adbf4618a49f489e06f2db5d&role.id=304a10ad50ff4fad86a065396035066f => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:21.131328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24f0b-b23b-4da8-b591-da8f036b06e5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.131837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24f0b-b23b-4da8-b591-da8f036b06e5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.131910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24f0b-b23b-4da8-b591-da8f036b06e5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.133823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:21.139199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e273f72-4ef9-4696-b4bb-519e6062d2b2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.139603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e273f72-4ef9-4696-b4bb-519e6062d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.139765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e273f72-4ef9-4696-b4bb-519e6062d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.161337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1e273f72-4ef9-4696-b4bb-519e6062d2b2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:21.162561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e273f72-4ef9-4696-b4bb-519e6062d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:21.250755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 52/99] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:21.262023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6817e-7729-46a5-ab2b-6475968118ab None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.262319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6817e-7729-46a5-ab2b-6475968118ab None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.262606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6817e-7729-46a5-ab2b-6475968118ab None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.263994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 48/100] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:21.269198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.269520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.269807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.288285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:21.290056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:21.292576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6817e-7729-46a5-ab2b-6475968118ab None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:21.344165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:21.406705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 53/101] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:21.431590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:21.493102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6817e-7729-46a5-ab2b-6475968118ab None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:21.503098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:21.542978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:21.543783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.544082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.544351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.556992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0cfb3554-3d1e-4552-8ecb-e208277d6730 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:21.565957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:21.566793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:21.567613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:21.569703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:21.571976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b17a-3920-4557-bb68-9f7d9532bf0b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.576861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b17a-3920-4557-bb68-9f7d9532bf0b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.577873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8b17a-3920-4557-bb68-9f7d9532bf0b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.579457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 50/103] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:21.580355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b17a-3920-4557-bb68-9f7d9532bf0b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:21.596357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdbc05-b16b-41cb-88c4-2e14af16cfb5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:21.668939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:21.670154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.670642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.671111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.674029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:21.675930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96b7c4-67a4-4393-8b34-54fc01782942 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:21.677802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 54/104] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:21.679330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.679814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.680446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.710519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:21.712250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:21.772054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:21.795986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8b17a-3920-4557-bb68-9f7d9532bf0b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:21.845496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:21.846234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:21.846521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:21.846801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:21.847557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:21.847866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:21.849519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:21.860431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 55/105] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:21.861346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:21.870762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 51/106] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:21.876933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:21.959394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.005071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aff60-ac61-4823-9773-21ed451218cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.019932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45b66-e0ee-4da6-8cdf-1b9cd372d315 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.042305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.043341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.043871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.044370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.045288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.047018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c605f94-54d5-438e-a18b-fb246b942cab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.058032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.059012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.059301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.059577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] PATH_INFO: `/v3/users/e75d33a9246c4320bcd448a98101e589` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.076284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] RBAC: Authorizing `identity:get_user(user_id=e75d33a9246c4320bcd448a98101e589)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.077934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.079719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 52/107] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:21 2022] GET /identity/v3/users/e75d33a9246c4320bcd448a98101e589 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:22.079980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 56/108] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:21 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:22.080481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.081858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a7f1-183b-41c1-a109-2f15cf7725fa None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.082364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a7f1-183b-41c1-a109-2f15cf7725fa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.082991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a7f1-183b-41c1-a109-2f15cf7725fa None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.084575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 57/109] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:22.094363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5a7f1-183b-41c1-a109-2f15cf7725fa None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.113853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.256724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fb832-c32c-4e28-aa22-f980bf40754c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.283686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5a7f1-183b-41c1-a109-2f15cf7725fa None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.297320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.305758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.306880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.307168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.307446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.320037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-bb89a69c-3bab-4a9c-b60f-29a6855042ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:22.329701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:22.330513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:22.331263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 53/110] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:22.332399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ef-99ec-4a82-ac9b-ad5503aa146d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.332399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ef-99ec-4a82-ac9b-ad5503aa146d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.332686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ef-99ec-4a82-ac9b-ad5503aa146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.334707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.335367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.335660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.336084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.349902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3c5317ef-99ec-4a82-ac9b-ad5503aa146d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.351092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3c5317ef-99ec-4a82-ac9b-ad5503aa146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.408344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.409883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76a02-477f-481e-9843-586aef53bbba None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.433679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 54/111] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:22.434948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177ad3-2894-48e0-99ff-15478b073791 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.435292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177ad3-2894-48e0-99ff-15478b073791 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.435577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177ad3-2894-48e0-99ff-15478b073791 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.437033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 55/112] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:22.445611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f1c0b-6bcf-4717-b391-7a8b166c9bed None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.445611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f1c0b-6bcf-4717-b391-7a8b166c9bed None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.445611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f1c0b-6bcf-4717-b391-7a8b166c9bed None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.445611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 56/113] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:22.445611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f1c0b-6bcf-4717-b391-7a8b166c9bed None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.448601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.534309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:22.534309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.534309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.534309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.549062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.550290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.552504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.564945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f1c0b-6bcf-4717-b391-7a8b166c9bed None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.601096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.601805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.602772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.603059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.603807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:22.604115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.605542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832baeac-98e6-4fe5-93a2-f8e198693203 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.619140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 57/115] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:22.619140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.619140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.619140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.629589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:22.630357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.636103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.637295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.701060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.710781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:22.712180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.747930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310305-8305-4c5e-9f4c-a04833737552 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.786210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.786945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.787234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.787515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.799218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.804986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:22.813008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:22.813930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:22.815527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.830996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979edc0-457c-49f1-a20f-46453ca5763d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.872452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.873336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.873641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.873924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.875218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.876740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.883636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:22.884490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.924842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233526-5a4d-4b54-98ea-5fbc319238a6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.949239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.961940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.962913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.963203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.963482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.964711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:22.966224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:22.967878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:22.968650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.998130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db763-a9af-4127-93f9-03a9439bdc50 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.035295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.036318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.036564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.036850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.045856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.049570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:23.058007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:23.058901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:23.059701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 60/121] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:23.060345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.091243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc7972-c4ae-4a11-9376-8e1ebe889317 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.127351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.128260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.128545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.128826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.139960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:23.148524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:23.149961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:23.150742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 62/122] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:23.151382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.167929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7562d-ff7e-42a0-938f-33f92ea92722 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.195131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.208162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.208836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.209112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.209409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.210291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.210470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.212715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.228973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 61/123] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.228973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.267479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dbc1d-5af1-43a9-b620-4ddbcb17c5c8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.294962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.312618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.313008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.313296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.313620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.314481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=e75d33a9246c4320bcd448a98101e589) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.314799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.316271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.323660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/role_assignments?user.id=e75d33a9246c4320bcd448a98101e589&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.324300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.353321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5714300-b8b4-4cc2-b9ba-b1f14b23b065 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.403465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.405198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.405678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.406130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.407801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.410165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.412681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.419303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.453372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca02f-b098-41e7-ac34-fa71210addbc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.492602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.499153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.500019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.500523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.500877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.502334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.502873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.504347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.515099 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.515923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.561423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5008f-4b26-4164-8e29-0aae20f42e8d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.582260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.607540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.608518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.609120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.609630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.610583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.611078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.613200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.625487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 63/127] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.626604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.641590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941db487-a72b-4a61-a57e-01e71830e97e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.685887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.687506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.687864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.688225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.689758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.691982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.697708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.699677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.754743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc715e-a481-4f33-8c22-c9d8fa348453 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.770544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.793443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.794351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.794637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.794918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/28e28983c7344573b7ffb88ba74b923f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.797265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, user_id=28e28983c7344573b7ffb88ba74b923f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.798675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.821516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 64/129] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:23 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/28e28983c7344573b7ffb88ba74b923f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:23.821516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.845199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e529167-7663-49d2-b22f-59c52ac8e5d7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.884470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.912564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.913624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.913989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.914377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.918223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.919898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.921874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 66/130] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.922706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.938203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d741586-806e-4c2b-b9c6-ce8f0d6030dd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.977990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.979288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.979927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.980512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.982008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.983788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.985791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.986810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.050147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.107633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdbdd-bcc0-4d4a-bbd5-ce80d62599e7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.134669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7f9e-5ae3-4d50-a59c-761f586ec2cd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.147237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.148666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.149838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.150243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.151689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.153284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.155370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 66/132] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.156231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.175999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.177146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.177801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.178236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] PATH_INFO: `/v3/projects/4eebee43adbf4618a49f489e06f2db5d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.179968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] RBAC: Authorizing `identity:get_project(project_id=4eebee43adbf4618a49f489e06f2db5d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.182356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.184816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/projects/4eebee43adbf4618a49f489e06f2db5d => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.185769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.260088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.290240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d1c0f-36bd-475a-807e-c65d83cbbd15 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.301707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.328330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cdfe-b206-47ad-89ce-35b5ab954b4a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.346197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.347439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.347729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.348012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.349209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.351239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.353774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 67/134] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.354875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.368176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.369696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.370223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.370702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/28e28983c7344573b7ffb88ba74b923f/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.373280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, user_id=28e28983c7344573b7ffb88ba74b923f, role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.375012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4695e-7f21-46b3-8c36-b3faf0856b82 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.395959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:24 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/28e28983c7344573b7ffb88ba74b923f/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:24.397973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153505-f70f-49d6-86b2-930366ab6315 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.398557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153505-f70f-49d6-86b2-930366ab6315 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.399113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153505-f70f-49d6-86b2-930366ab6315 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.400794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 69/136] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:24.401821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153505-f70f-49d6-86b2-930366ab6315 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.533942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153505-f70f-49d6-86b2-930366ab6315 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.559420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.584253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.585816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.586435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.587054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/3192aad0e5c64158b978fa55eb9121d5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.589601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, user_id=3192aad0e5c64158b978fa55eb9121d5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.591473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905926b2-6e5f-4f6e-a09d-851c36db8048 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.591587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4372ca4-803c-4f7c-8ad5-51b896c47468 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.611823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 70/137] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:24 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/3192aad0e5c64158b978fa55eb9121d5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:24.613728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.614518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.615033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.642469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:24.643712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:24.672133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.673039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.673320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.673643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] PATH_INFO: `/v3/projects/4eebee43adbf4618a49f489e06f2db5d/users/28e28983c7344573b7ffb88ba74b923f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.676697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] RBAC: Authorizing `identity:create_grant(project_id=4eebee43adbf4618a49f489e06f2db5d, user_id=28e28983c7344573b7ffb88ba74b923f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.678217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.708036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:24 2022] PUT /identity/v3/projects/4eebee43adbf4618a49f489e06f2db5d/users/28e28983c7344573b7ffb88ba74b923f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:24.771452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:24.827506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.899508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.990008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75c273-eac4-48ae-bde3-891cca991910 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.034303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.035114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.035397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.035675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.036918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.038379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4f4c8-e3a5-4335-b4e1-c8585d1708c9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.042140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 69/140] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:25.046690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:25.174487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7c1ef-853f-4961-b34c-12286680f75e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.184892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:25.231877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.232668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.233022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.233452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.234557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.236388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8377-a70f-40a7-9e16-6cdf6132444e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.275861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 72/141] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:25 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:26.085323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486666-24d7-4a2a-ac30-7f1a2315a23d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.085876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486666-24d7-4a2a-ac30-7f1a2315a23d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.085951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486666-24d7-4a2a-ac30-7f1a2315a23d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.088030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 70/142] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:26.096503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.096938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.097136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.119670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:26.120885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:26.209938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:26.234708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486666-24d7-4a2a-ac30-7f1a2315a23d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:26.358043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486666-24d7-4a2a-ac30-7f1a2315a23d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:26.365163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:26.397819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:26.398621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.399154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.399630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.410887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:26.419979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:26.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:26.421606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:26.430688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:26.550135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:26.561726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8ad30-217a-4dbc-b75d-44da554dc056 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:26.600795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:26.601485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.601778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.602096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.602971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:26.603280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:26.604665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579201b-06b6-462f-84bd-31482cfbe87a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:26.616964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:26.623342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:26.699317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac784d-8e5f-4f26-a9d1-e4acbaad22cd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.699627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac784d-8e5f-4f26-a9d1-e4acbaad22cd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.699875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac784d-8e5f-4f26-a9d1-e4acbaad22cd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.701349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 75/146] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:26.715646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.715926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.716194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.750052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:26.751270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:26.800232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e34-c34e-4413-8cf5-061545a55191 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:26.876280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:26.877267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:26.877586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:26.877871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] PATH_INFO: `/v3/users/e75d33a9246c4320bcd448a98101e589` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:26.878916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 76/147] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:26.879208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] RBAC: Authorizing `identity:get_user(user_id=e75d33a9246c4320bcd448a98101e589)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:26.880785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:26.882476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:26 2022] GET /identity/v3/users/e75d33a9246c4320bcd448a98101e589 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:26.889903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:26.924490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:26.997906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.033839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.060795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6aeb-30c0-4051-bc7f-b98743c48155 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.120192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.121064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.121347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.121660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.123172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.124789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.126579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:26 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:27.132821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.138820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef596300-a2d8-46ef-aa6d-56cc4ee21202 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.219039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.219844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.220124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.220396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.248764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:27.256575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:27.259179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:27.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:27.271403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:27.277949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.323876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77fd1-51bf-4891-ad92-4da5845b2565 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.394066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.394959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.395235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.395510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/e75d33a9246c4320bcd448a98101e589/roles/94d4ff20448949ffa591a02bd7ecd491` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.400204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, user_id=e75d33a9246c4320bcd448a98101e589, role_id=94d4ff20448949ffa591a02bd7ecd491)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.401674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.428398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 78/151] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:27 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/users/e75d33a9246c4320bcd448a98101e589/roles/94d4ff20448949ffa591a02bd7ecd491 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:27.449755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.459106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3875-73ab-47ea-b6f1-14b84c6fd853 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.503101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.503854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.504140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.504457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.505216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:27.505632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.507030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.521306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 74/152] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:27.528018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.549630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.664259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62e9aa-0041-454b-a2f9-b9352f757c90 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.703254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea484-510a-4790-a035-cd13df87356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.704178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea484-510a-4790-a035-cd13df87356f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.704512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea484-510a-4790-a035-cd13df87356f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.704793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea484-510a-4790-a035-cd13df87356f None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.706085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccea484-510a-4790-a035-cd13df87356f None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.707574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccea484-510a-4790-a035-cd13df87356f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.709292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 79/153] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:27.715757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.835353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5238f6-1bc4-4ddf-88ac-45ce1d9aa3cb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.883517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.884925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.885214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.885518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.924414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.982583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.984106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.098215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 75/154] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:28.104362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea484-510a-4790-a035-cd13df87356f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.200976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.221353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea484-510a-4790-a035-cd13df87356f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.256766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.257655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.257933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.258430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.259693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:28.261137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16fd16-efaa-4669-897e-d1cae10c3ec3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.262961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 80/155] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:28.268832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.302927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582160-2f8c-4bce-acc9-96d0e33fc7ec None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.303245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582160-2f8c-4bce-acc9-96d0e33fc7ec None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.303528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582160-2f8c-4bce-acc9-96d0e33fc7ec None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.305695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 81/156] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.317465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bac7fb-dca0-4c49-8ef4-b5fb67c0a4cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.317465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bac7fb-dca0-4c49-8ef4-b5fb67c0a4cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.317465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bac7fb-dca0-4c49-8ef4-b5fb67c0a4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.346353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-95bac7fb-dca0-4c49-8ef4-b5fb67c0a4cb None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:28.347551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95bac7fb-dca0-4c49-8ef4-b5fb67c0a4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:28.382427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.436205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 82/157] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:28.437072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b45e0-149c-42ae-b925-6c96b86d51d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.441407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c8c2d-4744-4525-8692-5d0d94045797 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.441407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c8c2d-4744-4525-8692-5d0d94045797 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.441407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c8c2d-4744-4525-8692-5d0d94045797 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.441407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 83/158] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.441957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c410ee-130a-4dc7-98c2-23e76323959a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.442156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c410ee-130a-4dc7-98c2-23e76323959a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.442442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c410ee-130a-4dc7-98c2-23e76323959a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.446386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 84/159] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.447813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.448282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.448748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.482711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:28.484312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:28.486171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.486843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.487305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.487748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.488810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:28.489282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:28.490913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d182fd5-6e2d-4b21-a7ae-46cd04f4a031 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.506485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 76/160] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=304a10ad50ff4fad86a065396035066f => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:28.508068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.508508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.508937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.541878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:28.543330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:28.614832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 85/161] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:28.616779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.624743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 77/162] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:28.638179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.677938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.753642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00f0c2-8a15-4a65-87ed-a818385a1cdd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.790142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.794528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.795678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.796170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.796647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.810559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:28.819617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:28.820588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:28.821367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:28.824439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:28.825720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.899580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd2bc-7597-4bed-b015-ad6b9bca7f93 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.941032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.942254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.942742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.943217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.953724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.955882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:28.966456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:28.967404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:28.968200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 78/164] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:28.968822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.020308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef014f-ac63-4e62-949f-9a81e7e7bd1e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.097365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353a67-f0fd-4d4b-b4cb-a424dec943ab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.105810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.106629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.106913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.107188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.125761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.126364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:29.140733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:29.141935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:29.142704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 87/165] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:29.143333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.166780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.167520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.167805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.168133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.168902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.169212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.172352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.189764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 79/166] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.190855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.344932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84a36-8aa2-46ae-b0ab-1e71ac5255a6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.384360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11e87-b6ed-402c-b263-61bb5456e29a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.409727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.423991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.424676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.424966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.425252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.426050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.426359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.429223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.443811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 88/167] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.444643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.464549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.465276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.465603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.465884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.466638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.466945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.468345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.484339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 80/168] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.486252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.561761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.632141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457343-fa29-4e71-a512-f0c37707f2d8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.664001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef193-e0d0-4f1e-93fb-18f822f97bdf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.694377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.695256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.695603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.695948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] PATH_INFO: `/v3/users/3192aad0e5c64158b978fa55eb9121d5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.697177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] RBAC: Authorizing `identity:get_user(user_id=3192aad0e5c64158b978fa55eb9121d5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.698679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.700320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 89/169] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/users/3192aad0e5c64158b978fa55eb9121d5 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.701081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.723764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.724641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.724924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.725203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.727662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.729128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef1ad-99d8-42c7-b74f-b37eebb76414 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.731992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.733198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f3c5-a982-40d2-b79d-da24ae308d75 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.733510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f3c5-a982-40d2-b79d-da24ae308d75 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.733795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f3c5-a982-40d2-b79d-da24ae308d75 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.735216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 82/171] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:29.735728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123f3c5-a982-40d2-b79d-da24ae308d75 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.809717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.864293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1b40-ba64-4575-9a4e-b933b39ac383 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.904548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.906011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.906648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.907123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] PATH_INFO: `/v3/users/28e28983c7344573b7ffb88ba74b923f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.908886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] RBAC: Authorizing `identity:get_user(user_id=28e28983c7344573b7ffb88ba74b923f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.910576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.913082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 90/172] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/users/28e28983c7344573b7ffb88ba74b923f => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.914294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.941673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123f3c5-a982-40d2-b79d-da24ae308d75 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.943744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.007314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.008020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.008839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.009097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.094024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416e6d0-bf84-49f1-addf-e665e23c3d01 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.132510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.134102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b577-92b7-4006-9edb-52be55827ced None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.151423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.167177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.167759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.168039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.168313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.274762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.276232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.343536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 83/173] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:30.350469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6aca-55fc-41ec-b3d5-3b17b912a583 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.350959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6aca-55fc-41ec-b3d5-3b17b912a583 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.351412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6aca-55fc-41ec-b3d5-3b17b912a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.358633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.375625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b16c6aca-55fc-41ec-b3d5-3b17b912a583 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:30.377313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b16c6aca-55fc-41ec-b3d5-3b17b912a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:30.421520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 91/174] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:30.426175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.453341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 84/175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:30.455225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc29d2-f0ed-4e22-b2dd-8b81ddbd2465 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.455640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc29d2-f0ed-4e22-b2dd-8b81ddbd2465 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.456041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc29d2-f0ed-4e22-b2dd-8b81ddbd2465 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.457458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 85/176] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:30.458263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc29d2-f0ed-4e22-b2dd-8b81ddbd2465 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.462757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.549737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc21f-4a87-4b5c-83fc-3a4f89e8493c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.567284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc29d2-f0ed-4e22-b2dd-8b81ddbd2465 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.590743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.591386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.591666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.591935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.599172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.605373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.606263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.606551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.606826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.608034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.609544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ea6e-5b2e-4dc2-a3c7-6d2799720448 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.611459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 86/177] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.612496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae715c41-11ff-43ea-a5bc-77d450278c4c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.612790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae715c41-11ff-43ea-a5bc-77d450278c4c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.613069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae715c41-11ff-43ea-a5bc-77d450278c4c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.617845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 87/178] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:30.617845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae715c41-11ff-43ea-a5bc-77d450278c4c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.678810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.680363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.709818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.723297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae715c41-11ff-43ea-a5bc-77d450278c4c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.758935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.759878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.760164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.760442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] PATH_INFO: `/v3/projects/4eebee43adbf4618a49f489e06f2db5d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.761678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] RBAC: Authorizing `identity:get_project(project_id=4eebee43adbf4618a49f489e06f2db5d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.763134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284cad3-ba3c-460f-96d2-51915e0702af None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.764847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 88/179] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/projects/4eebee43adbf4618a49f489e06f2db5d => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.766024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.766313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.766593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.783628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:30.784817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:30.794435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:30.794435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.853667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.861816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 89/181] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:30.863349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.905146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695a85-2a77-4deb-858c-43c83abfb13c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.933434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.943410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.944201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.944483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.944760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.955353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-abb16fea-910a-4a5b-88c5-57c466b71a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:30.964080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:30.965011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:30.965844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 93/182] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:30.970825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.971114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.971393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.978723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73bd3-2f93-4a37-bbc9-6a11d7ec8d59 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.987222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:30.988398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:31.013168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.013863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.014152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.014425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.015256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=3192aad0e5c64158b978fa55eb9121d5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:31.015566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.017024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.023062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/role_assignments?user.id=3192aad0e5c64158b978fa55eb9121d5&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.025011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.063219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 94/184] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:31.064448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.112924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.158639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540153f8-0e49-4c0b-85f6-29f9fe719d1f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.200673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.200673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.200935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.201177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.201272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db27af-38a8-46fc-bb40-fee1d1572261 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.202038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=4eebee43adbf4618a49f489e06f2db5d, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:31.202346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.203793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.210099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 91/185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=4eebee43adbf4618a49f489e06f2db5d&role.id=304a10ad50ff4fad86a065396035066f => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.214010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.221731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.248226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.249103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.249395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.249683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.250948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.252450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579230a5-979e-49c9-8cb6-76089196c1f3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.254464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 95/186] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.256950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117fc7-61e8-495a-9f39-e7d6c08d7be6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.256950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117fc7-61e8-495a-9f39-e7d6c08d7be6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.256950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117fc7-61e8-495a-9f39-e7d6c08d7be6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.257495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 96/187] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:31.261524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117fc7-61e8-495a-9f39-e7d6c08d7be6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.354937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1254c4-1a34-40c3-8b1e-434018cfbba4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.382589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.384962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117fc7-61e8-495a-9f39-e7d6c08d7be6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.393686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.394593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.394882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.395283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.412404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:31.420744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:31.421928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:31.422791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 92/188] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:31.423578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.430316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.431004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.431742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.431742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.432290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:31.432593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.433998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.443410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 97/189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.448064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.492255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.533624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e24233-281d-4c9f-abfe-db5ee16c06d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.546290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5469e-b44b-4892-9828-94e4ddf6ed43 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.569640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.570958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.571270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.571722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.572672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.574169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f06da-fcbe-4011-b8e8-3349081e7f1e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.575980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 93/190] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.577117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.577420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.577703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.581547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.582198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.582476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.582751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.583578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=28e28983c7344573b7ffb88ba74b923f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:31.583885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.585295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.592164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/role_assignments?user.id=28e28983c7344573b7ffb88ba74b923f&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.592927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.594039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:31.595232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:31.660359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.693406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 94/192] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:31.693406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.726172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3bee7-34ac-4e90-9d5a-0d4feae974af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.738345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.767179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.767784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.768065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.768349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.769105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:31.769962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.770857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.780273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 99/193] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.780887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.815277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4805-3d40-43b6-bd1e-caeedc1be954 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.856264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.857133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.857438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.857719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.871511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.872979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.874686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 95/194] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:31.875451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.898227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d259056-83d8-4605-b139-e24fd2b25441 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.920505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.931348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.932091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.932377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.932657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.933366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.934844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.953710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 100/195] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:31 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:31.954507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.987318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.990735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef16aaa-1d8b-455f-a441-59be5cd3899e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.032226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.032943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.033226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.033684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.046806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:32.054773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:32.056498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 96/196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:32.062235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.089654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a30e-1d8b-4948-83f1-42982b6ce034 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.130936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.131826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.132096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.132390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.134266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.135739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.141813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 101/197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.142466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.187515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ba51-1d22-4c82-ad51-29a30018dd94 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.189100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.235944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.236893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.237348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.237858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.268139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.275414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8132-d14f-46af-99db-5d670e217d06 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.328105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.328353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.328645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.328917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.329719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:32.330028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.331417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.338535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.340569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.342576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.343410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.459094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8afb-e58d-4d30-8f42-255516e7b7fb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.469043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:32.470688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.472965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.504666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.505699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.506203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.506699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.536791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.582817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.584598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.605638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafda515-6ab7-4a01-ace8-a0cdabbf9178 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.653791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.654682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.654968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.655248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] PATH_INFO: `/v3/users/e75d33a9246c4320bcd448a98101e589` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.656482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e75d33a9246c4320bcd448a98101e589)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.658139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.660907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 98/200] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/users/e75d33a9246c4320bcd448a98101e589 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.661882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.695529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 103/201] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:32.696940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.760097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.766822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.804106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f18ff-ecb7-493f-a8ac-90b9b097a2b0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.819623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bf207-6772-45e3-9426-a99e317eb38f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.843865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.844642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.845028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.845434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.846741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.848293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.850142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 99/202] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.850990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.860236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.861129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.861582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.861998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.937814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.939717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.958991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b60f7-4664-493c-91e7-4989626083f9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.995273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.996292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.996678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.997053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.998418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:33.000066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:33.002295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 100/203] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:33.003074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.004154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.012296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.057959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 104/204] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:33.059076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.111381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b322-13f7-4e3c-8e92-b3b184db5140 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:33.147980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:33.149319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.149728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.150084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.150980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=3037a79a07bc4f75af75e1e4fd56c415) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:33.151381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:33.152927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:33.158846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 101/205] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/role_assignments?user.id=3037a79a07bc4f75af75e1e4fd56c415&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:33.159723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.175208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef9c85-1dfc-4060-b902-51a5005ff7ca None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:33.219189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:33.220179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.220642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.221190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.222283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=3037a79a07bc4f75af75e1e4fd56c415) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:33.222829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:33.224644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:33.232621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 105/206] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/role_assignments?user.id=3037a79a07bc4f75af75e1e4fd56c415&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:33.240846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.289024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1dded-c2f6-45e3-b770-6299026bbc4e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:33.338912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:33.339852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.340125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.340405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.346551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:33.348213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ae89-3174-4e93-80c7-06e89ccdf897 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:33.350381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 102/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:33.356772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.402554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.530468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585fcdf-82ff-416a-9111-8b65d342a3b2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:33.567400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:33.568437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.568920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.569407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.570550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, scope.project.id=2ae7485aa40440f1ad4a51e497546933, user.id=e75d33a9246c4320bcd448a98101e589) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:33.571062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:33.572699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613e8f-62d6-4dc7-b19d-b6a328822e7c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:33.579135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 106/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/role_assignments?user.id=e75d33a9246c4320bcd448a98101e589&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:34.334895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad855d5-ef29-4345-94d9-f51d333b0cdd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.335293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad855d5-ef29-4345-94d9-f51d333b0cdd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.335486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad855d5-ef29-4345-94d9-f51d333b0cdd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.336875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 103/209] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:34.342064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc314e-0ae4-4665-9881-c5ec62ec2572 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.342350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc314e-0ae4-4665-9881-c5ec62ec2572 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.342627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc314e-0ae4-4665-9881-c5ec62ec2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.359535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0ddc314e-0ae4-4665-9881-c5ec62ec2572 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:34.360709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ddc314e-0ae4-4665-9881-c5ec62ec2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:34.428823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 107/210] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:34.453354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad855d5-ef29-4345-94d9-f51d333b0cdd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.526535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851febd-a684-4b6e-b64e-cf23b197d46f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.526850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851febd-a684-4b6e-b64e-cf23b197d46f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.527093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851febd-a684-4b6e-b64e-cf23b197d46f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.528513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 108/211] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:34.535527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.536145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.536145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.558688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:34.560845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:34.570963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad855d5-ef29-4345-94d9-f51d333b0cdd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.576258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.612644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.613690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.614115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.614533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.622944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.628346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:34.637644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:34.638530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:34.639308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:34.642115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 104/212] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:34.653427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 109/213] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:34.653599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.677635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.754588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44bbc-f11e-42f9-84da-9c2bed246df7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.791193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.791853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.792140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.792416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.793154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:34.793488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.794879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:34.803494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:34.809297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.811360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183224f-90be-4e27-a445-20e38e290ca4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.845002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.845840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.846165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.846387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.847550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.849001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:34.855742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:34.858171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.879609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.882476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.935618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d9e9-f8ad-492d-8423-36f6a43c4f4c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.976406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.977181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb2b0-17e1-4cd7-b976-0041f628b370 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.977423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.977706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.978342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] PATH_INFO: `/v3/users/e16bb6501cfd415fbf0669d3b6a0333d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.995449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] RBAC: Authorizing `identity:get_user(user_id=e16bb6501cfd415fbf0669d3b6a0333d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.997212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.004426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 106/216] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/users/e16bb6501cfd415fbf0669d3b6a0333d => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:35.005322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.022046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.024193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.024814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.025293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.026296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.028251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.063850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 111/217] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:34 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:35.129242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4ad3-b268-4785-b332-0c76f6ed0b9b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.149526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.168974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.169737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.170023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.170300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.250983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.252530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2543-d8aa-44ad-8e35-a2d74617f627 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.358983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 107/218] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:35.364323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.454238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539086dd-0777-4ec5-b34b-193dfeaebffd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.454554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539086dd-0777-4ec5-b34b-193dfeaebffd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.454736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539086dd-0777-4ec5-b34b-193dfeaebffd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.456336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 108/219] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:35.462044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.462918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be7f3-f982-4f5e-995d-828f96f41adc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.463208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be7f3-f982-4f5e-995d-828f96f41adc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.463492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be7f3-f982-4f5e-995d-828f96f41adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.483144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-361be7f3-f982-4f5e-995d-828f96f41adc None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:35.484361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-361be7f3-f982-4f5e-995d-828f96f41adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:35.507233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.508414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92e35-8e6e-4123-96dc-0888641dbf1b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.548302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.549173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.549480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.549758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.550984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.552507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.554619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 112/220] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:35.563047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.578985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 109/221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:35.580336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efc46-2c5a-4e7e-880c-b1cd7237393a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.580627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efc46-2c5a-4e7e-880c-b1cd7237393a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.580908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efc46-2c5a-4e7e-880c-b1cd7237393a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.591132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 110/222] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:35.597675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.597967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.598244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.627691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:35.628862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:35.679850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd4f32-10b3-4acf-91a4-00458504fc8e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.699276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:35.700145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.721438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.722080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.722366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.722701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.723549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=e16bb6501cfd415fbf0669d3b6a0333d) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:35.723913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.725426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.732494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 113/224] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/role_assignments?user.id=e16bb6501cfd415fbf0669d3b6a0333d&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=304a10ad50ff4fad86a065396035066f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:35.745173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.748580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.787699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.813733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee2ec-ee71-49d6-8973-666adc6af323 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.874794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.875997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.876519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.876999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.903300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:35.911783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:35.912663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:35.913479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 112/225] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:35.917215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c569-13d0-45b5-beb8-442788d8db5f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.921699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.954832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.955993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.956494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.956987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.984479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:35.992961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:35.994027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:35.994938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:36.005988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:36.012781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.115305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.125520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90b3b8-59d9-4102-a2af-caee0c02e45d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.191823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.192936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.194120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.195065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.196140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.198082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70ff30-9ab3-4975-b539-eca22e9a4809 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.198559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.200098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.213711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.221753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 113/227] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.224179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.280713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.281311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.281613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.281929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.282690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.282995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.284370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.305832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 115/228] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.310473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.437234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415d8f-4e1b-41dc-81f9-00d47c438bc2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.483398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43f971-e9ae-448e-8dda-23d139bf6fdb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.503419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.504330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.504612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.504888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.510360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.511881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.513944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 114/229] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:36.522162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.525731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.546500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.547361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.547643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.547969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.551085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.554483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.560054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.564587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.634269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.698635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83665-3a3b-4339-bdb7-13e265e61b91 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.706149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528ad95-c0e8-4927-91da-aa735884c2cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.742023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.742919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.743195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.743467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.743704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.744658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.744764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.744933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.745208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.746131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.746423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.747956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.748167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:36.749956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.753793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.755509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.817826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.859613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d300d-19a8-4b2b-9e17-4cd199daab6e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.906814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.908106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.908610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.909092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/users/3037a79a07bc4f75af75e1e4fd56c415/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.911873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, user_id=3037a79a07bc4f75af75e1e4fd56c415, role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.913757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc516d-d922-49e5-895b-78576e2301a2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.920624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9580d2-40dc-42dc-ad4f-63511f1cc55c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.940320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 118/233] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:36 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/users/3037a79a07bc4f75af75e1e4fd56c415/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:36.970224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.971515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.972022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.972556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/users/3037a79a07bc4f75af75e1e4fd56c415/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.974859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, user_id=3037a79a07bc4f75af75e1e4fd56c415, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.977163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768236-e9f5-4c87-91f2-452bc6d15680 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.981768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.001919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:36 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/users/3037a79a07bc4f75af75e1e4fd56c415/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:37.708480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55888-8b51-45e9-9d68-fa7b18296b94 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.708996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55888-8b51-45e9-9d68-fa7b18296b94 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.709069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55888-8b51-45e9-9d68-fa7b18296b94 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.710667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 119/235] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:37.716337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.716802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.716925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.738199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:37.739395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:37.808319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f2f5-9aee-453e-961d-4feeb2936199 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.808646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f2f5-9aee-453e-961d-4feeb2936199 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.808871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f2f5-9aee-453e-961d-4feeb2936199 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.810264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 120/236] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:37.823631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.823908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.824195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.838816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 117/237] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:37.846387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:37.847596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:37.882987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.973843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:37.996368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.068411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62e992-d359-400c-9a9c-89de4229f543 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.085732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.121740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.139407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.140224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.140506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.140785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.161529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:38.169333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:38.170216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:38.171007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:38.175054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66e2c-dbbe-4a0d-aa96-3b15d6df2873 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.183117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:38.184878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.239971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.240689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.240966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.241241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.243657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.245220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.247033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:38.262540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.312477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782842b3-2ec0-4b76-9ffe-c3fa7d42a5a7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.349761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.350444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.350728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.351006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.351815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.352126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.353600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa58b-0e18-405a-b888-74a41133ec63 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.363190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:38.364523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3831af-4b34-417d-b50b-9dd153279803 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.364822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3831af-4b34-417d-b50b-9dd153279803 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.365143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3831af-4b34-417d-b50b-9dd153279803 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.366722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 120/242] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:38.371955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3831af-4b34-417d-b50b-9dd153279803 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce84e-1452-4334-b048-1783872a6606 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.417806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.425828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.426692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.427020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.427199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.428665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.430941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eee961-fcc5-4834-b393-d7fb38ee5439 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.457529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 123/243] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:38 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:38.458088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.458931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.459299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.459685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.508282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:38.509451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:38.532385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3831af-4b34-417d-b50b-9dd153279803 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.582632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.583516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.583795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.584078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] PATH_INFO: `/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.600097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] RBAC: Authorizing `identity:get_user(user_id=59c41b08ff6f4bb0bc96d0ef12093bba)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.602427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.604489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 121/244] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:38.609874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.670037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:38.694510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.720296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ddbad-b2f5-4db6-83f0-bfaf658684af None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.729114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.757519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.758351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.758765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.759051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.805526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd95b5-1947-45d7-91e9-2ae86adc375e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.808010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.840615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.842397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.847244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.848231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.848664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.849089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.860838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:38.870024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:38.870929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:38.871793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:38.878874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 125/246] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:38.880317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.957887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 122/247] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:38.958803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.969761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.989885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e80a-85a0-4ac0-bb8e-40430c0a5e80 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.029099 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.030092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.030524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.030951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.031863 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.032392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.034591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.049508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 126/248] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:39.051291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.074113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd3c3-f2c3-4d52-b793-06c25db4e219 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.082472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.116296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.118151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.118557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.118839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.120160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.121819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.123775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 123/249] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.129623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.166570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538047-0023-43cb-b7ec-d6c96681a9d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.204785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.206026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.206537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.207031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] PATH_INFO: `/v3/users/e16bb6501cfd415fbf0669d3b6a0333d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.208529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] RBAC: Authorizing `identity:get_user(user_id=e16bb6501cfd415fbf0669d3b6a0333d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.210437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.217236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 127/250] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/users/e16bb6501cfd415fbf0669d3b6a0333d => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:39.218122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.219268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.242894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8255-aa7c-4137-933c-2411265b2e9f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.281916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.282328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.282613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.282888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.283709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=59c41b08ff6f4bb0bc96d0ef12093bba) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.284017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.285492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.293140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/role_assignments?user.id=59c41b08ff6f4bb0bc96d0ef12093bba&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:39.341787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.344993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2269a-e01b-42ec-b2c0-1598bf61197e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.386171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.387179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.387608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.387942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.389471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.391014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344ce4-9c72-4efd-bb23-91b9e0c91bdf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.397543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.400020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.523644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5acc25-a3d6-4ed4-b8f7-3eec9b008de0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.542225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20eec2-67a5-4d9e-b972-b4b10f5a5394 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.542460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20eec2-67a5-4d9e-b972-b4b10f5a5394 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.542701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20eec2-67a5-4d9e-b972-b4b10f5a5394 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.544292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 129/253] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:39.555336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.555620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.555900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.562339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.563551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.564005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.564455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/users/e16bb6501cfd415fbf0669d3b6a0333d/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.566622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, user_id=e16bb6501cfd415fbf0669d3b6a0333d, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.568473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01556436-d0f7-40b1-bd4f-8e073cefac39 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.578754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.585547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 125/254] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:39 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/users/e16bb6501cfd415fbf0669d3b6a0333d/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:39.590138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:39.591584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:39.629068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675d02-89d1-465f-ba5f-4766c54860fb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.629481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675d02-89d1-465f-ba5f-4766c54860fb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.629687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675d02-89d1-465f-ba5f-4766c54860fb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.631281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 126/255] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:39.638299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.638587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.638854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.670485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:39.671714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:39.739794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 130/256] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:39.784061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 127/257] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:39.790517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.821973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.983570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.994121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8418-9864-476b-a4cb-0edbd5ee5ac4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.011213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61690f9-edba-43bd-a026-9ab11085bff3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.051482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.052298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.052577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.052855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.074931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:40.077443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:40.089982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:40.090915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:40.091707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 131/258] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:40.097134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.098030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.098307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.098412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.098580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.130447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:40.138594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:40.139472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:40.140250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:40.145625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 128/259] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:40.152325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.256266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd7c6f-4a89-469e-9278-39e1fd0c74a5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.330645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.330645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.330841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.331097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.333961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:40.334269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.335664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.359470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 132/260] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:40.360684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.365807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3cc80-036a-4075-a861-d593236c0094 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.404238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.466144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.466821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.467100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.467372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.468122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:40.468426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.469848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.485261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 129/261] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:40.494520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.581707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7739-0e57-4747-870c-0caa4bccb79b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.609813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.644069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.644940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.645219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.645524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.647419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.650490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.652132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 133/262] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:40.657403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.702722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5a2b-b77b-4a41-9ee1-a936ef4cba18 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.765782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.767432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.767814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.768092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] PATH_INFO: `/v3/users/3037a79a07bc4f75af75e1e4fd56c415` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.771002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=3037a79a07bc4f75af75e1e4fd56c415)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.772539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.775222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 130/263] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/users/3037a79a07bc4f75af75e1e4fd56c415 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:40.781967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.818899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.856543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35ac83-afdf-45dd-98b9-47aaeddf7535 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.908054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.908712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.913798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.914821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.989170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b941-4805-4cfa-844a-aa4fbba42ab6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.025076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.035317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.038114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.059708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.060586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.062484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.062917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.181784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.200612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 134/264] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:41.206526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.206659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.208385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.371316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 131/265] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:41.376840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.408212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39fff-93a5-45a3-a16e-e5e7089c90a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.423785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.498841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.500269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.500756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.501229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.508997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.510516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.512276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 135/266] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:41.519238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.615575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74903-cb86-4dba-94db-9dba66c64a93 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.633860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.705824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.706701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.706984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.707258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.714154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.715625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.717676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 132/267] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:41.724197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.736888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc790-06f4-4ab2-9f26-a0b51f08a086 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.814067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.814650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.814928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.815199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.816037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=3037a79a07bc4f75af75e1e4fd56c415) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:41.816346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.821400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5add-cdf3-41d3-857e-d4e4640cf77f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.832274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 136/268] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/role_assignments?user.id=3037a79a07bc4f75af75e1e4fd56c415&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:41.903075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.927871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f75c-1518-4cde-901f-544aca7b64f9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.983578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.984238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.984519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.984787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.986004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=3037a79a07bc4f75af75e1e4fd56c415) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:41.986317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.987795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c173e-e09e-49be-bb90-b6698b17c64a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.998767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 133/269] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/role_assignments?user.id=3037a79a07bc4f75af75e1e4fd56c415&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:42.088912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce168d-cfb0-442d-8078-872a9b2218d5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.089897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce168d-cfb0-442d-8078-872a9b2218d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.090374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce168d-cfb0-442d-8078-872a9b2218d5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.091984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 137/270] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:42.097650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.098289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.098783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.114862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44621e7-b33e-4d32-aff5-0029d0e51401 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.115510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44621e7-b33e-4d32-aff5-0029d0e51401 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.115987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44621e7-b33e-4d32-aff5-0029d0e51401 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.119026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 138/271] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:42.122517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:42.124000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:42.126993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.127277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.127554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.155666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:42.157253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:42.267531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 139/272] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:42.268677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 134/273] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:42.292644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.301014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.358953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.418940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.440843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7032d7-8fc5-44e9-a4ce-e1a646a4c2e0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.443434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fcaf-24a9-4ad8-9535-1ca75d4467f1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.478296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.479091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.479375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.479647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.480138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.480874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.481163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.481578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.482648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.484112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ec30c-f606-4363-a408-30b9f4fade67 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.485771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 135/274] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.490248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10264b-fcfb-4b64-8bb2-0da34770ca5c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.490248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10264b-fcfb-4b64-8bb2-0da34770ca5c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.490248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10264b-fcfb-4b64-8bb2-0da34770ca5c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.490248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 136/275] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:42.494253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10264b-fcfb-4b64-8bb2-0da34770ca5c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.495556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8668d81f-1744-4c78-83d5-02b4b7eace16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:42.505335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:42.506334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:42.507124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:42.510509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.510797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.511077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.529216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:42.530439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:42.605803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 141/277] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:42.606655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.614364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10264b-fcfb-4b64-8bb2-0da34770ca5c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.651170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.653680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.654320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.654595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.654870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.655582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.657049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.680468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 137/278] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:42.681291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.691536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.751363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c30d5-ed87-45c4-8ac2-2a90fad7e161 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.798183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.798855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.799138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.799416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.800179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:42.800485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.801973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5012-0f26-4128-9ffb-a004d8d05e14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.805166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c903-d950-4dc6-ada8-565d538e53e6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.817496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 142/279] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.817496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229c1a-3c35-4c5c-a7a0-92812c3f8794 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.817496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229c1a-3c35-4c5c-a7a0-92812c3f8794 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.817496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229c1a-3c35-4c5c-a7a0-92812c3f8794 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.817496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 143/280] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:42.821745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229c1a-3c35-4c5c-a7a0-92812c3f8794 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.848570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.849367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.849676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.849950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.864748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ab738339-81ad-4427-9e49-9b9ee3d27a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:42.873339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:42.874300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:42.875074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:42.875659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 138/281] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:42.880776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.880776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.880776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.894380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:42.895582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:42.944405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.955533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229c1a-3c35-4c5c-a7a0-92812c3f8794 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.962809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.973527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 139/282] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:42.974424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.009888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.010843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.011147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.011465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] PATH_INFO: `/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.012701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=59c41b08ff6f4bb0bc96d0ef12093bba)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.014306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.016320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 144/283] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.017106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.109803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963a86-0031-4e6e-a42a-0ee3cbefde88 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.133979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597efd-7f94-4250-a1ce-11ce6970e2a3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.144916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.145617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.145899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.146172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.146914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:43.147215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.149427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.158030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 140/284] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.158848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.173009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.173876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.174262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.174539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.186131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:43.194708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:43.195708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:43.197132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 145/285] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:43.198821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.221827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.228325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.267901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186d35-13e7-4871-8e97-c9a47bde53d6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.302989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.303854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.304137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.304412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.306488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.308361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.314887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 141/286] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.315838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.329924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eb7bd-4e26-43b2-bfa2-977a88e3c048 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.370235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.371410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.371861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.372307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] PATH_INFO: `/v3/users/b72baefe159f43bfab3d3329f6d64889` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.390833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] RBAC: Authorizing `identity:get_user(user_id=b72baefe159f43bfab3d3329f6d64889)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.392515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.394583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 146/287] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/users/b72baefe159f43bfab3d3329f6d64889 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.395659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.418854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798155f6-76b5-4170-a9bd-e36e89a55939 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.443051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.454682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.455356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.455636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.455912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.456652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:43.457427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.459093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.470258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 142/288] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.470878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.496889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.519816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6794-c1d8-4b25-810a-622305639868 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.564599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.565766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.566190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.566637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/users/59c41b08ff6f4bb0bc96d0ef12093bba/roles/94d4ff20448949ffa591a02bd7ecd491` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.568871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, user_id=59c41b08ff6f4bb0bc96d0ef12093bba, role_id=94d4ff20448949ffa591a02bd7ecd491)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.570666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.588627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 147/289] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:43 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/users/59c41b08ff6f4bb0bc96d0ef12093bba/roles/94d4ff20448949ffa591a02bd7ecd491 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:43.589734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.614555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ce64-fc6b-45af-af37-1aa3327b96a7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.709225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.709888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.710173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.710449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.711854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, user.id=b72baefe159f43bfab3d3329f6d64889, scope.system=all) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:43.712076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.713492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.733680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 143/290] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/role_assignments?user.id=b72baefe159f43bfab3d3329f6d64889&scope.system=all&role.id=304a10ad50ff4fad86a065396035066f => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.734860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15f95-247c-41b1-8d7c-32a84d829f39 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.785237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.786421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.786859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.787282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] PATH_INFO: `/v3/users/e16bb6501cfd415fbf0669d3b6a0333d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.788841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] RBAC: Authorizing `identity:get_user(user_id=e16bb6501cfd415fbf0669d3b6a0333d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.791742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.793752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 148/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/users/e16bb6501cfd415fbf0669d3b6a0333d => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.801531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.879644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.950389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed0ab-58d5-4ee8-9b85-8ec53c68432a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.000180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.002539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.002982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.003411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.112390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.114636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.196638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.276998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 144/292] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:44.282602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.307309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.437425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2dc4-5297-46a5-bbf9-77fdaccf50c8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.479028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.480148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.480576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.480993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.482407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.484414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56100108-3bd2-4a69-a9e8-24ad04f48dce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.486346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 149/293] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:44.494467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.653633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317fb5-f353-493e-8b0e-55ed9948c99d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.704822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.705518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.705801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.706077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.706907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=e16bb6501cfd415fbf0669d3b6a0333d) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:44.707219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.708669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f6b3-cd78-4ffd-8510-fda7a7b11ad5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.718317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 145/294] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/role_assignments?user.id=e16bb6501cfd415fbf0669d3b6a0333d&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=304a10ad50ff4fad86a065396035066f => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:45.229289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ab0-9ea7-499c-93c1-686c07e21058 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.229289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ab0-9ea7-499c-93c1-686c07e21058 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.229289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ab0-9ea7-499c-93c1-686c07e21058 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.229289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 150/295] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:45.236191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b11cb-608a-473d-a5ba-a3d9811e597b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.237030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b11cb-608a-473d-a5ba-a3d9811e597b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.237562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b11cb-608a-473d-a5ba-a3d9811e597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.255234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f56b11cb-608a-473d-a5ba-a3d9811e597b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:45.256781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f56b11cb-608a-473d-a5ba-a3d9811e597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:45.269335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.350810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 146/296] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:45.376851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee116ab0-9ea7-499c-93c1-686c07e21058 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.484710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.520135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee116ab0-9ea7-499c-93c1-686c07e21058 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.539310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a967-637f-47f3-a5e8-8f8b47fe039a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.540059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a967-637f-47f3-a5e8-8f8b47fe039a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.540544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a967-637f-47f3-a5e8-8f8b47fe039a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.542499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 147/297] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:45.552366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.552902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.553410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.579862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.580665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.580952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.581234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.588228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:45.591142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:45.592365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:45.600263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:45.601135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:45.602613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 151/298] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:45.609027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.685242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 148/299] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:45.712602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.725709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3f17e-d9d4-4aa5-927e-905a02a27a25 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.771777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.773684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.774145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.774566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.776091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:45.776549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.778623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.786039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.793155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 152/300] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:45.798090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.798310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.827262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220d607-5221-425e-a3e0-f7732bd141a6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.864348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.865174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.865480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.865755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.867171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.868813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.875247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:45.876097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.930490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343f46-c9b2-4fde-b81b-cd0ff4825195 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.985181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.986448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.986913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e55c9f-47b3-475a-98fc-f6dc490517dd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.987198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.987683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] PATH_INFO: `/v3/users/12237fd697204757a25d35c5adb94ea6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.010932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] RBAC: Authorizing `identity:get_user(user_id=12237fd697204757a25d35c5adb94ea6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.012390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.015098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/users/12237fd697204757a25d35c5adb94ea6 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:46.020934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.035357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.036522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.036990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.037752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] PATH_INFO: `/v3/groups` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.039920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.041853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184134-7f62-415f-8a3a-a526430f8c88 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.063330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 150/303] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jun 20 05:57:45 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:46.094586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.144711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f394-fd04-422f-b0da-3e6e0752159d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.183265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.184196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.184744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.185169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.186279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, user.id=12237fd697204757a25d35c5adb94ea6, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:46.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.188427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537557c-eeff-4fcd-8c25-8ed4466bedf7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.200629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 154/304] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/role_assignments?user.id=12237fd697204757a25d35c5adb94ea6&scope.system=all&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:46.243207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb6248-9e56-4e76-a4a0-311e3fda5a86 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.243875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb6248-9e56-4e76-a4a0-311e3fda5a86 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.243875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb6248-9e56-4e76-a4a0-311e3fda5a86 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.245495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 151/305] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:46.250850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.251455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.251982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.270886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:46.272128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:46.337887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eed6-3c64-4cc4-8139-481161def45f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.338165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eed6-3c64-4cc4-8139-481161def45f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.338447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eed6-3c64-4cc4-8139-481161def45f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.340118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 152/306] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:46.345642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.345918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.346201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.352292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.355039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 155/307] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:46.366279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:46.368880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:46.379070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.435227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.450115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 153/308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:46.472483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.488227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f5175-5518-4058-aa52-93d4a58a974c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.525712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da31e-412f-4894-85b0-e68c913813be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.526655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da31e-412f-4894-85b0-e68c913813be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.526949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da31e-412f-4894-85b0-e68c913813be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.527334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da31e-412f-4894-85b0-e68c913813be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.538428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da31e-412f-4894-85b0-e68c913813be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-116da31e-412f-4894-85b0-e68c913813be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:46.553151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:46.554127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:46.555493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:46.556095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 156/309] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:46.562843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da31e-412f-4894-85b0-e68c913813be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.581563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36313f2-5b8b-4bae-9f14-7739117c3bde None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.614720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.620463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.621336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.621739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.622088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.634102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:46.645669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:46.646558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:46.647342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 154/310] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:46.651778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.695391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da31e-412f-4894-85b0-e68c913813be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.709993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.733635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.734305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.734593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.734873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.735630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:46.735941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.737326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.746594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 157/311] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.757476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.784245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607de-423d-48f0-9d5b-dd0fab34440f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.820957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.821674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.821963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.822240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.822996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:46.823308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.824824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.838255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 155/312] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.839587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.868070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18273-7ff7-4f54-ada1-78f203c36ad5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.901759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.904574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.905732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.906158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.906672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] PATH_INFO: `/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.908067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] RBAC: Authorizing `identity:get_user(user_id=59c41b08ff6f4bb0bc96d0ef12093bba)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.909733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.916449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 158/313] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/users/59c41b08ff6f4bb0bc96d0ef12093bba => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:46.917555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.950028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab0eb4-3caa-4ba3-a0b2-4a9dd93e0db8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.963378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.001199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.002161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.002449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.002726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] PATH_INFO: `/v3/users/b72baefe159f43bfab3d3329f6d64889` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.004657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b72baefe159f43bfab3d3329f6d64889)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.006518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.013686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/users/b72baefe159f43bfab3d3329f6d64889 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:47.015005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.035847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa72b4-17ae-4c2b-a3d4-5f434ac4100e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.080025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.080682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.080949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.081271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.153548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21be8c-0993-498f-80fa-d98f2c467fd8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.161542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.163377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.184188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.200963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.203196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.203480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.203761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] PATH_INFO: `/v3/system/users/b72baefe159f43bfab3d3329f6d64889/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.205356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b72baefe159f43bfab3d3329f6d64889, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.206827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.213285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.225590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 157/315] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jun 20 05:57:47 2022] PUT /identity/v3/system/users/b72baefe159f43bfab3d3329f6d64889/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:47.288543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:47.295489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.426402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1eccb-21c1-4d72-8f92-1a3dfc415037 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.463055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.463913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.464191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.464465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.465686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.467229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49072582-bbf3-414a-939a-bd6508d016c7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.469287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 158/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:47.474823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.578581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9bb37-4721-4159-a9e0-ddf07289d12b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.614125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.614778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.615059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.615336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.616165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, scope.project.id=5899564e4e184c388cec498d38b04051, user.id=59c41b08ff6f4bb0bc96d0ef12093bba) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:47.616475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.618674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22ea7-1c7f-402f-b7b6-f6231828a373 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.624621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 160/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/role_assignments?user.id=59c41b08ff6f4bb0bc96d0ef12093bba&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:48.262982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778169f2-8ef2-4abc-a33c-614ac2760219 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.263383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778169f2-8ef2-4abc-a33c-614ac2760219 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.263655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778169f2-8ef2-4abc-a33c-614ac2760219 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.265071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 159/319] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:48.270081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6e5f-a707-451a-ae53-84cab4763a9a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.270372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6e5f-a707-451a-ae53-84cab4763a9a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.270651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6e5f-a707-451a-ae53-84cab4763a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.283671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.289650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cb3e6e5f-a707-451a-ae53-84cab4763a9a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:48.291194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cb3e6e5f-a707-451a-ae53-84cab4763a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:48.369108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:48.377114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782ffc-a2b9-4e62-930a-b7e709498ab1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.377605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782ffc-a2b9-4e62-930a-b7e709498ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.377679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782ffc-a2b9-4e62-930a-b7e709498ab1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.379138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 160/321] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:48.385036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.385331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.385641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.392570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782ffc-a2b9-4e62-930a-b7e709498ab1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.404199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:48.405416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:48.460317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.474506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 162/322] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:48.497549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.513960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782ffc-a2b9-4e62-930a-b7e709498ab1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.549514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.550297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.550587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.550837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.551981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.553435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.556039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 161/323] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:48.561085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.571826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.610519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6b0a-1ced-491f-841e-06c87679d995 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.645084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.645909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.646190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.646465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.657820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:48.666063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:48.666936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:48.672880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:48.673654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e6f6-ef9d-4c93-87fd-8c3bc12d8689 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.673746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 163/324] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:48.675135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.696805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.717639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.718312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.718597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.718877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] PATH_INFO: `/v3/groups` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.719568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.721021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.737958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 162/325] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:48.790601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fce1-5394-4cc7-be6c-2629ac01238b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.819940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.830993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.831969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.832453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.832902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.833877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:48.834402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.836110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.845872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 164/326] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:48.852084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.959432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c6d09-1928-4fbe-bc9b-6074b1291ffd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.995413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.996299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.996584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.996862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] PATH_INFO: `/v3/users/12237fd697204757a25d35c5adb94ea6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.998106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] RBAC: Authorizing `identity:get_user(user_id=12237fd697204757a25d35c5adb94ea6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.999573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49752c7a-c356-486c-8fcc-2130e2f8abed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.005453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 163/327] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/users/12237fd697204757a25d35c5adb94ea6 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.007217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.121799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f0e1-3882-4463-b952-5f0cdb5739a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.157998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.158921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.159207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.159492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] PATH_INFO: `/v3/system/users/12237fd697204757a25d35c5adb94ea6/roles/94d4ff20448949ffa591a02bd7ecd491` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.161029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12237fd697204757a25d35c5adb94ea6, role_id=94d4ff20448949ffa591a02bd7ecd491)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.162466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48df47-8ad2-4f8a-b8f1-c3bda9846040 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.174921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 165/328] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jun 20 05:57:49 2022] PUT /identity/v3/system/users/12237fd697204757a25d35c5adb94ea6/roles/94d4ff20448949ffa591a02bd7ecd491 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:57:49.356127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1251-e0eb-4652-a556-ee041440fdc1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.356427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1251-e0eb-4652-a556-ee041440fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.356701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1251-e0eb-4652-a556-ee041440fdc1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.358260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 164/329] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:49.364479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.364762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.365038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.385299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:49.386553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:49.435324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.456308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 166/330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:49.481656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1251-e0eb-4652-a556-ee041440fdc1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.549408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.622408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1251-e0eb-4652-a556-ee041440fdc1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.658772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.659495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.659784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.660067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.672261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:49.681035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:49.681945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:49.682712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:49.683315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 165/331] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:49.688170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.804032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58021e8-1994-4c84-87e6-9758a00aa853 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.841248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.841959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.842245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.842526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.843288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.843596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.844999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.854799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 167/332] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:49.862472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:50.004823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380d3c-1c1f-4757-8c4f-ec34adc0e959 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.022139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.046581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.047518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.047830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.048101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] PATH_INFO: `/v3/users/b72baefe159f43bfab3d3329f6d64889` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.054100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=b72baefe159f43bfab3d3329f6d64889)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:50.056447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a22b46-6ee3-49a9-acf6-02a9a8327ee2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:50.058142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 166/333] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/users/b72baefe159f43bfab3d3329f6d64889 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:50.064053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:50.149506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.222175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e00d-2f30-4ab9-920e-3685820c4813 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.267151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.267724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.268000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.268270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.269104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] RBAC: Adding query filter params (role.id=304a10ad50ff4fad86a065396035066f, user.id=b72baefe159f43bfab3d3329f6d64889, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:50.269430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:50.270852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b8f0-3c34-4694-b099-d947d29b1801 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:50.287930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 168/334] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:50 2022] GET /identity/v3/role_assignments?user.id=b72baefe159f43bfab3d3329f6d64889&scope.system=all&role.id=304a10ad50ff4fad86a065396035066f => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:51.488880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12262b-4648-485d-9ab7-701c2c9bfeeb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.489922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12262b-4648-485d-9ab7-701c2c9bfeeb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.490422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12262b-4648-485d-9ab7-701c2c9bfeeb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.492998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 167/335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:51.494765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d4a2-9ad8-48eb-9b58-3f2cd9f9651a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.495542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d4a2-9ad8-48eb-9b58-3f2cd9f9651a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.496036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d4a2-9ad8-48eb-9b58-3f2cd9f9651a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.497872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 169/336] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:51.502907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.503447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.503916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.522561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:51.523596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.524489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:51.524835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.525313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.555051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:51.556445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:51.618871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 168/337] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:51.666233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:51.698008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:51.751500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:51.806747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:51.897298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21478d74-9424-40ed-9acc-096daba0fa04 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:51.903981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2f5f-422e-4704-b9b9-04012811ec20 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:51.929767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:51.969892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:51.970708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.970983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.971256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.975765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:51.977198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.977510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.977899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.001241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.006272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.010707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.011621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:52.012400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.015412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.016265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:52.017063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:52.017693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 169/339] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:52.021908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.022232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 171/340] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:52.028801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.156754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1488b-4f9c-4ca9-9813-4c1e4fd0f810 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.197599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.198272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.198553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.198829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.199567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:52.199871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.201250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35dd25-9707-4ec7-abbc-6fd8c6373f04 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.210280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 170/341] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.212256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048afe24-e41b-4d4a-97b3-1d8194d9a8f1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.212541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048afe24-e41b-4d4a-97b3-1d8194d9a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.212818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048afe24-e41b-4d4a-97b3-1d8194d9a8f1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.214220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 171/342] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.215918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.220641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.220641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.220641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.237516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd599a-7f8f-4a74-9ef8-1a6f75265750 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.237715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.238926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:52.265896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.315761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:52.317169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.318224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.318899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.319177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.319448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.320307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:52.320784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.329284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.350389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 172/344] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.357856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.513024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e9f46-ebd6-43c4-8235-3346ec03c40b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.538456 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05ecf-14e6-454c-a707-65f10dfc5833 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.557885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.559025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.559316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.559597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.583119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.584190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.584671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.585147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.607398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.622589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.664723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.666502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.673742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.675189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401e141-03fb-41e5-8408-81c2a757ddb9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.769239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 173/345] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:52.770441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.794067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 173/346] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:52.795741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13111fd-7a13-4a2d-b1d1-75c9ec81d576 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.796171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13111fd-7a13-4a2d-b1d1-75c9ec81d576 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.796593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13111fd-7a13-4a2d-b1d1-75c9ec81d576 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.798435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 174/347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.799319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13111fd-7a13-4a2d-b1d1-75c9ec81d576 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.837851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.866000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.879767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340042a8-f9fb-464c-9835-1470bdfe3a51 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.917648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.918213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13111fd-7a13-4a2d-b1d1-75c9ec81d576 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.918805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.919263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.919717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.931545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.945738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.946765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.947714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:52.950458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 174/348] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:52.955820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.956889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.957315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.957486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.957984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.959317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.962140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1675bbc-338c-4ebb-ad92-27d36dc582a6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.964341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 175/349] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.965758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.966211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.966629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.984813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.986293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:53.078178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 176/350] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:53.079114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.091811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a76ff1-2efd-4b83-8787-0efa812c6129 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.115259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.135420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.136588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.137092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.137593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.139128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.140846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.142952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.143896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.152798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.209737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6db9d-b610-4ff1-a0cb-46289edca20d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.252110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.253107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.253611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.254068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.254998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.255504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.257056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.266645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 177/352] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.267720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.276656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9115b-9ae7-48f0-8c70-e2bdd66881c4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.327427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.328964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.329488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.329972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.341991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.344452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.346483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 176/353] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.347263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.397459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19552-73b7-4e1d-b48f-566e74c7cf87 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.411973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.416342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.447530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.448323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.448608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.448883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.461535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:53.470931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:53.471828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:53.472610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 178/354] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:53.473250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.481554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e4df0-5e7b-4e3d-b548-b8262d6d7aa0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.524543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.525488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.525781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.526059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.527701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.529299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.531166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 177/355] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.531749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.621213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe423fd-a781-4564-b1ca-1c55b9d970c1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.667005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.667890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.668174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.668451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] PATH_INFO: `/v3/users/12237fd697204757a25d35c5adb94ea6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.668862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcd3d-ac89-4e5f-8553-4edf3a84732d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.669779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] RBAC: Authorizing `identity:get_user(user_id=12237fd697204757a25d35c5adb94ea6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.672547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb83ada-e9f5-4458-a0dc-9994a7eeb47e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.674283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 179/356] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/users/12237fd697204757a25d35c5adb94ea6 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.675486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acefc-8c54-4d70-b28a-da8cf5af7f7f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.675770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acefc-8c54-4d70-b28a-da8cf5af7f7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.676045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acefc-8c54-4d70-b28a-da8cf5af7f7f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.678008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 180/357] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:53.679096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83acefc-8c54-4d70-b28a-da8cf5af7f7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.693646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.711583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.712506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.712790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.713072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.713940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=2ae7485aa40440f1ad4a51e497546933) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.714255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.715779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.721828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 178/358] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=304a10ad50ff4fad86a065396035066f => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.724475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.732742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.828503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83acefc-8c54-4d70-b28a-da8cf5af7f7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.881439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.881439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.881755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.881934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.882931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.883242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.884779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf34e-7585-4548-8d66-c2ac2b91fd02 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.889258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084833c-ae6a-47e1-b735-7f4c1845bd7f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.895865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 181/359] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.897322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ff4e-a500-441e-b382-b5000c099c6c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.897634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ff4e-a500-441e-b382-b5000c099c6c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.899085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ff4e-a500-441e-b382-b5000c099c6c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.900794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 182/360] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:53.901626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177ff4e-a500-441e-b382-b5000c099c6c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.930740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.932069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.932570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.933079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.934136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=2ae7485aa40440f1ad4a51e497546933) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.935249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.936958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea631ce4-c151-40c0-8f78-f5a93a1ee3d0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.943504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 179/361] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.945092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95505-a3ac-4e7e-a347-7b047ad44505 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.945653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95505-a3ac-4e7e-a347-7b047ad44505 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.946134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95505-a3ac-4e7e-a347-7b047ad44505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.968173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aea95505-a3ac-4e7e-a347-7b047ad44505 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:53.969741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aea95505-a3ac-4e7e-a347-7b047ad44505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:54.042544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.058946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177ff4e-a500-441e-b382-b5000c099c6c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.063764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.077450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:54.080960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.080960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.080960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.097395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:54.098622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:54.119298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.120563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.121197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.121724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.122814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] RBAC: Adding query filter params (role.id=94d4ff20448949ffa591a02bd7ecd491, user.id=12237fd697204757a25d35c5adb94ea6, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:54.123372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.125171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.151899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/role_assignments?user.id=12237fd697204757a25d35c5adb94ea6&scope.system=all&role.id=94d4ff20448949ffa591a02bd7ecd491 => generated 510 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.215588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:54.216273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.324939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5ed0-6cfe-442f-af01-277768eae36a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.400256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6dde6-735b-4784-90cb-a864c1bc5093 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.403849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.404448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.404726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.405000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.422089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.459143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.463666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.464489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.464767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.465037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.479119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:54.486448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:54.487396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 182/365] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:54.490418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.516539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.518402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.610325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747e8f-f9d2-498c-9e19-e450cc52bdc2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.635389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 184/366] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:54.637683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.650225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.651026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.651315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.651874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.663265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:54.672490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:54.673358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:54.674164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 183/367] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:54.674806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.707942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.718296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.767798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea266b-3482-41eb-bcc4-60b6d0ef5c0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.798374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfb84-9997-4443-bad6-616c40e23370 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.810667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.811338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.811614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.811879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.812966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:54.813271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.814974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.826995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 185/368] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.827934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.848728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.850266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.850865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.851969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.853437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.855975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.858830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.859961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.971127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a6955-c007-437c-abf9-7997317848b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.984941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.991009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e8ec-4b54-4bcf-ad62-db2f80d4431b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.001497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.016959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.017942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.018367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.018785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.019931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:55.020484 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.022279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.028906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.029663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.029947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.030224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.037465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.039285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.109001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.110502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.162681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7cb3-cd31-4f25-a7b6-060fabefab54 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.202368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.203708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.204262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.204737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.206262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.207071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.209257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.212752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 187/371] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.214010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.216240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:55.218095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.277916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.322093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c6d38-384a-42ca-914e-0e5c29ad3e89 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.337650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8978f-bda7-49a3-8ff8-fb0d373d2c98 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.364762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.365457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.365777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.366057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.366923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=5899564e4e184c388cec498d38b04051) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:55.367381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.369277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.374276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.374931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.375213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.375490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.375666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 186/373] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=304a10ad50ff4fad86a065396035066f => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.376562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.445914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.457119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.458679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.490834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecaf3-f44a-468a-99f7-8d5870a77c23 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.521264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.529582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.530421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.530755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.531038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.532304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.533937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.535668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 187/374] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.542082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.588475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 188/375] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:55.594341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.655349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c8a5-0dc9-466b-9937-43e2c5031d38 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.685054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.693660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.694526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.694808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.695127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.696438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.697926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.699848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:55.705488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.719537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eb970-c25c-4b0b-9c28-dead6d315997 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.762496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.763858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.764347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.764855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] PATH_INFO: `/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.766374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] RBAC: Authorizing `identity:get_project(project_id=4f9a6bdb9ae7447fb41cd2764e1194d4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.768142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.770580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 189/377] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:55.776913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.817722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.841225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad040e4-d9cc-48d5-b815-dfffecbbb136 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.912060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cce5b-a50d-4d63-b378-f7fb3ad28765 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.930272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.930954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.931242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.931520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.932355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=5899564e4e184c388cec498d38b04051) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:55.932674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.934178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.943645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 189/378] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:55.956902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.958162 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.958628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.959132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] PATH_INFO: `/v3/groups/72fba2f90bdd4877908c9ca192aa1caa` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.974271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] RBAC: Authorizing `identity:get_group(group_id=72fba2f90bdd4877908c9ca192aa1caa)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.976191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75fd2e-302e-46d1-9992-2c64b18e2ece None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.978812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 190/379] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/groups/72fba2f90bdd4877908c9ca192aa1caa => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.984760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.082398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.139132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbbb9b-c0fd-428f-b65b-6a05fb528ec6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.188931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.189655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.189940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.190218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.191048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] RBAC: Adding query filter params (group.id=72fba2f90bdd4877908c9ca192aa1caa, role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=4f9a6bdb9ae7447fb41cd2764e1194d4) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:56.191356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.192808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237b07-1d7e-424f-bdd1-de2da9b42324 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.204870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 190/380] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/role_assignments?group.id=72fba2f90bdd4877908c9ca192aa1caa&scope.project.id=4f9a6bdb9ae7447fb41cd2764e1194d4&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:56.227072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7767e-5cbc-44fd-a8d8-eb4e16b5d0e8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.227411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7767e-5cbc-44fd-a8d8-eb4e16b5d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.227645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7767e-5cbc-44fd-a8d8-eb4e16b5d0e8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.229458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 191/381] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:56.235602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.235602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.235881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.259591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:56.260867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:56.363523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 191/382] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:56.395578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7767e-5cbc-44fd-a8d8-eb4e16b5d0e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.504170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.525129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7767e-5cbc-44fd-a8d8-eb4e16b5d0e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.566212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.567406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.567892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.568375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.579375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:56.589145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:56.590104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:56.590866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:56.593278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 192/383] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:56.599402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.690734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.754597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa90a-ace4-473b-83e3-7967b0cd3129 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.806201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.806893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.807177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.807453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.808203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:56.808507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.810021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d56f0-1538-4b1d-88dc-10180958f61e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.819051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 192/384] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:56.824403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.969168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db918-8781-4a34-bf4a-8a142da10ef0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.969551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db918-8781-4a34-bf4a-8a142da10ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.969676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db918-8781-4a34-bf4a-8a142da10ef0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.971304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 193/385] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:56.972912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaad37-a0ae-4370-bfe2-510d7eb4d546 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.978443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.978731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.979008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.012706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:57.013915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:57.040820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.041705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.041987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.042263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.044240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.045717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.049510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 193/386] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.052695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.096819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.141146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 194/387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:57.229130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806917fc-7f5c-4890-bac4-ce12bf1fa361 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.233079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.313667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.314524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.314803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.315077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.316495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.317966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.319662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 194/388] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.326071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.326628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.440042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f283a3-726a-4171-b0c6-f2fcf26a6113 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.499022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.523743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.524573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.524911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.525190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.526963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04599-e8b0-4baf-8304-ec85510016cd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.550468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:57.565815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:57.566722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:57.567503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:57:57.568806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 195/389] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:57.576251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.577664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.580534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.580816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.581091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/groups/75723049a3744e92a477fb40c62d1f4e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.584010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, group_id=75723049a3744e92a477fb40c62d1f4e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.590381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.611873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 195/390] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jun 20 05:57:57 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/groups/75723049a3744e92a477fb40c62d1f4e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:57.709093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b671f-2600-4747-b7f6-afcc406f9d28 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.717758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.754690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.755338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.755625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.755957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.756720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:57.757029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.758678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.772230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 196/391] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.778269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.893897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eecd5c-3e33-407f-9504-a779c8e47d3e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.929701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.930561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.930839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.931118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.932366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.934009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.936011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 196/392] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.941502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.057199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fccb-0525-490e-a88b-19d1763be258 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.099046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.099969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.100255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.100530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.101809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.103375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1698-e310-47ae-b497-cbc7ad69cda9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.105398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 197/393] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:58.111175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.124587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.238770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289062b3-fcad-4ed0-bad3-da6117fc0aab None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.269740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e175e-1c79-437e-a503-cb4549b8873c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.270044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e175e-1c79-437e-a503-cb4549b8873c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.270294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e175e-1c79-437e-a503-cb4549b8873c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.271647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 198/394] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:58.279249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.279517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.279800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.284089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.285183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.285649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.286067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933/groups/75723049a3744e92a477fb40c62d1f4e/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.288420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ae7485aa40440f1ad4a51e497546933, group_id=75723049a3744e92a477fb40c62d1f4e, role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.290096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.311988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 197/395] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jun 20 05:57:58 2022] PUT /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933/groups/75723049a3744e92a477fb40c62d1f4e/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:58.313118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:58.314512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:58.369779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.419196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 199/396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:58.463553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.545328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.589343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53390b2-7ad3-4c4e-bdfd-8c00f349be8d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.630996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.631801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.632080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.632398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.643139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:58.651436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:58.652329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:58.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 198/397] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:58.658557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.764656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15fa29-7cc4-4be1-a3f1-dce136f3e19a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.800906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.801613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.801899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.802241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.802989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:58.803341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.804803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aeb63-b71e-4ee6-a373-350579eda7de None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.813886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 200/398] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:58.819506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.859470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8aca-0d88-4cf0-ab03-4c55002ee5b3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.859768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8aca-0d88-4cf0-ab03-4c55002ee5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.859950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8aca-0d88-4cf0-ab03-4c55002ee5b3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.861668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 201/399] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:58.868062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f789d-631d-4dcd-ad90-ec7edda3b981 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.868062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f789d-631d-4dcd-ad90-ec7edda3b981 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.868284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f789d-631d-4dcd-ad90-ec7edda3b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.894504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-410f789d-631d-4dcd-ad90-ec7edda3b981 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:58.895718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-410f789d-631d-4dcd-ad90-ec7edda3b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:58.932352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.974810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741c9aa-c5fb-41fc-84a8-de7f514cb457 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.994297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:58.996250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981dda0-79cc-4915-b1ac-e777a1337e4d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.996541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981dda0-79cc-4915-b1ac-e777a1337e4d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.997209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981dda0-79cc-4915-b1ac-e777a1337e4d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.998548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 203/401] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:59.004155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.004453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.004736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.022324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.027378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:59.028851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:59.031788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.032662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.032973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.034069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.034583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.038960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.041039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 199/402] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.042062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.118100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 204/403] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:59.119344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.155672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964652d8-6eeb-4ee7-b8a7-eaa203c1d97f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.192765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.193628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.193940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.194577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.206647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:59.219049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:59.219949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 200/404] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:59.225893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.239584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.253909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07cea-fd94-4e7e-893f-36c170682a19 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.286516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.295069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.296295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.296778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.297268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.298718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.300604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.302584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 205/405] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.303720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.345574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93352-719b-4000-a033-2d58428cac00 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.384457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.385451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.386800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.387138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.405600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:59.417241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:59.418122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:59.418927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:57:59.421662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e815a-3306-4e26-a1ef-7bdf850c4642 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.423491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 201/406] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:59.425432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.458661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.459666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.461134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.461724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.462873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:59.463574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.465732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.476653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 206/407] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.478687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.502553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.550868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2523cb-3c7e-42ce-857e-20b71a3e5a88 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.569639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.587577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0b2c-8f47-4382-935e-0cc69074663f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.590956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.592082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.592564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.593008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/groups/75723049a3744e92a477fb40c62d1f4e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.595296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, group_id=75723049a3744e92a477fb40c62d1f4e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.597006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.614074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 202/408] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jun 20 05:57:59 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/groups/75723049a3744e92a477fb40c62d1f4e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:59.615564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.624599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.625336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.625720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.626002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.626770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:59.627120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.628603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.641898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 207/409] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.654337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.755039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b8622-2a88-4aca-9a24-34dc37f010cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.798269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.799170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.799460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.799733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] PATH_INFO: `/v3/groups/72fba2f90bdd4877908c9ca192aa1caa` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.801113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] RBAC: Authorizing `identity:get_group(group_id=72fba2f90bdd4877908c9ca192aa1caa)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.802889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.805969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 203/410] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/groups/72fba2f90bdd4877908c9ca192aa1caa => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.812134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.866812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.874971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.892178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859f8e-2c01-4102-8f7a-8eb79a834cdc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.935897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.938944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.939519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.940003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.941473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.942111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a9270-8e99-4f61-bc11-3c6346b19dfa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.943496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.946144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 208/411] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.958412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.996688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.997643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.997929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.998209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] PATH_INFO: `/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.000825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4f9a6bdb9ae7447fb41cd2764e1194d4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.002416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.008967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 204/412] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.026782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.096722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54844a0-3041-4179-9c05-89636dc5bafe None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.170616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.171831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.172320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.172814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.175968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.177705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.180019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 209/413] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.188809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.207974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.223617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818fd38-81e7-445f-a57b-595d312598a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.239559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.263116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.264048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.264374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.264653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] PATH_INFO: `/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4/groups/72fba2f90bdd4877908c9ca192aa1caa/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.266664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f9a6bdb9ae7447fb41cd2764e1194d4, group_id=72fba2f90bdd4877908c9ca192aa1caa, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.268095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3023-4b2d-4da5-accd-3603d5d8fda6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.284276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 205/414] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:00 2022] PUT /identity/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4/groups/72fba2f90bdd4877908c9ca192aa1caa/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:58:00.286816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd27be-92ce-4886-883e-df9fe65a8912 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.287268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd27be-92ce-4886-883e-df9fe65a8912 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.287724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd27be-92ce-4886-883e-df9fe65a8912 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.293466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 206/415] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:00.298849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.299138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.301708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.334591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:00.337416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:00.349643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550b6f-72b8-4cb0-8dd7-e228eadffd84 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.391360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.392386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.392748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.393373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051/groups/75723049a3744e92a477fb40c62d1f4e/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.397071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=5899564e4e184c388cec498d38b04051, group_id=75723049a3744e92a477fb40c62d1f4e, role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.399798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.416680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 210/416] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:00 2022] PUT /identity/v3/projects/5899564e4e184c388cec498d38b04051/groups/75723049a3744e92a477fb40c62d1f4e/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:58:00.444126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:00.469226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.563619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.593023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbf62-93e5-4156-86af-f295fd9b6d6d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.631403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.632498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.633181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.633493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.644247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:00.652882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:00.653807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:00.654676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 211/418] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:00.660044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.781647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae615b10-8f63-4272-a84f-0d227434dae4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.784352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.824631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.825815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.826335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.829743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.830742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.831263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.832847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292663-6c9b-4249-bc82-085bf00a3432 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.842063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 208/419] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.847611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.960260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4a34-5b93-4cff-935a-f1d40684625b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.968366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436843-55d4-4714-9acf-8f2a3473962d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.968952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436843-55d4-4714-9acf-8f2a3473962d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.969489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436843-55d4-4714-9acf-8f2a3473962d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.971055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 209/420] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:00.976953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.977565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.978049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.010570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:01.011766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:01.021921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.022587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.023268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.024162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.030096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.150655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:01.155185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.157669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.187409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.282308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 212/422] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:01.287657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.327252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.401597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f995eb-2a67-4682-b70e-475cbacfa0b5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.443896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.444771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.445054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.445327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.447619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.449070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.450793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 213/423] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.457180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.469741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.475089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4300-7092-4bb8-95c4-307e30489a36 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.544646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.545477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.545759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.546033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.566392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:01.588071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:01.588993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:01.589827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:01.592226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 211/424] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:01.597942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.622338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad5bf6-c9ea-48df-b77f-fbe99c34cec3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.624799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.687151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.687816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.688102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.688374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.694080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.696085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.698127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.703677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.715300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eaac8-29c0-4bd9-a81d-18157ec80cda None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.763940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.764985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.765506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.765986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.766958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.767487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.769059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.778305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 212/426] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:01.783662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.807720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.894845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befdd3-d41f-4cb5-8ac5-e0e5878c5d59 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.935304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.935953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.936230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.936503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.937633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443238ab-bbd8-4823-86a6-e2b2fcf3f192 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.998264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.999750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.000241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.000722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.001800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=2ae7485aa40440f1ad4a51e497546933) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.002356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.004101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91ca2b-997a-47ea-9d6d-71c87d6276bf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.017825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 215/427] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=304a10ad50ff4fad86a065396035066f => generated 611 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:02.046305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.048608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.068941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.082032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6f70-bec0-492f-8171-4cc69ab9c9ea None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.082352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6f70-bec0-492f-8171-4cc69ab9c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.082597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6f70-bec0-492f-8171-4cc69ab9c9ea None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.084306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 216/428] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:02.107101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.107312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.107542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.154191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:02.155756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:02.211344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 213/429] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:02.217426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.235339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.295825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 217/430] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:02.328931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.364268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fafd9-a6a7-4d88-9f19-85c3b28bd194 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.384730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.408959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.410287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.410773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.411266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] PATH_INFO: `/v3/projects/2ae7485aa40440f1ad4a51e497546933` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.412689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] RBAC: Authorizing `identity:get_project(project_id=2ae7485aa40440f1ad4a51e497546933)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.414973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.417217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/projects/2ae7485aa40440f1ad4a51e497546933 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.422761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.465746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efcb8-9f3a-4c14-8c3b-ea7796ac5a24 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.518145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.518955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.519233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.519506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.535681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:02.540536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201783b-9928-4067-a263-22a557dc8671 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:02.546002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:02.546905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:02.547711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 218/432] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:02.554888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.585700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.593550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.594411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.594691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.594967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.597666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.599097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.604842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 215/433] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:02.610899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.689096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.704208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee70e8-34ef-4926-959b-4e0190786dca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.749009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.749779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.750155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.750553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.751412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.753876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.755096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.755267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d1103-db64-4dbe-a095-603fe2767853 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.767854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 219/434] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:02.774789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.809037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.810167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.810590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.811254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.812700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=2ae7485aa40440f1ad4a51e497546933) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.813520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.815729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20f55-5eba-43ca-bb5c-6707e8df2c4f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.826402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 216/435] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=2ae7485aa40440f1ad4a51e497546933&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.828415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0c03-2123-4bc7-9842-131ebc233a00 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.828679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0c03-2123-4bc7-9842-131ebc233a00 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.830656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa0c03-2123-4bc7-9842-131ebc233a00 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.830656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 217/436] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:02.837097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.837455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.837770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.862472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:02.863702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:02.901141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.920338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed532-c9d9-4c60-888c-16adb6ff5fcf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.953740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 218/437] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:02.965361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.966423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.966926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.967398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.974493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.031298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.063190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.065129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab0d03-e8bf-4554-b5b2-89d9579a50aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.094882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591372bd-3cec-4514-af36-b06b773b1409 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.136684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.137511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.137798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.138076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.150072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2b7b5be6-0c9a-45f7-80f5-0bed8d2d0e59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:03.158454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:03.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:03.160166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:03.165542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc0aac-781c-400b-91a4-46c9486f8e71 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.165542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc0aac-781c-400b-91a4-46c9486f8e71 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.165542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc0aac-781c-400b-91a4-46c9486f8e71 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.165542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 220/439] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:03.169452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.169656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc0aac-781c-400b-91a4-46c9486f8e71 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.188358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:03.189695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.189980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.190258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.206567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:03.207678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:03.285930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 221/441] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:03.286791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.299410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc0aac-781c-400b-91a4-46c9486f8e71 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.312781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.339675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.340413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.340760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.341102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.341955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:03.342263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.343650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.352118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 221/442] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:03.353135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.390517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89653f8d-6f3e-4395-8048-516b0a6a006a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.410559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.429119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.430017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.430304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.430586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.431771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.433251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.435134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.435807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.457749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f011bb-6559-4eae-b4ad-2a1a0229db6c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.492821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.493642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.493926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.494206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.503969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:03.511689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:03.512671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:03.513740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:03.514641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.540453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212cf8-97d3-4295-9fc4-5f7ca966a7db None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.544021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.574992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.575632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.575922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.576199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.612889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3e5a3-681a-45c0-900a-23d3ad3be7b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.629319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.643462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.644922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.647082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.648265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.648550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.648827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.650029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.651458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.653228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 223/445] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.653843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.741484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:03.742910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.753440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.757979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f6ba-be82-493f-aeec-b5082c398533 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.792254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.792843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.793129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.793432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.794184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:03.794497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.795863 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.803689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 224/447] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.804596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.828135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.844638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78899332-ab9d-48f6-8e04-81a81aee5124 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.877802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.878450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.878734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.879012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.879833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=304a10ad50ff4fad86a065396035066f, scope.project.id=5899564e4e184c388cec498d38b04051) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:03.880147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.881604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.888120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 224/448] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=304a10ad50ff4fad86a065396035066f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.888894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.905140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b2c88-3e7f-4241-aa9b-4b6379947143 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.946214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.947110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.947387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.947660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] PATH_INFO: `/v3/projects/5899564e4e184c388cec498d38b04051` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.948931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] RBAC: Authorizing `identity:get_project(project_id=5899564e4e184c388cec498d38b04051)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.950435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.952164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/projects/5899564e4e184c388cec498d38b04051 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.957742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.991482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.018856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec489b-789b-4fb2-afa7-725ffcaf45a8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.063012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.063884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.064723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.065149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.079118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25951-6900-4d5d-854d-b016bcd42397 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.090433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.120677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.121695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.121982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.122260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] PATH_INFO: `/v3/groups/75723049a3744e92a477fb40c62d1f4e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.123472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] RBAC: Authorizing `identity:get_group(group_id=75723049a3744e92a477fb40c62d1f4e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.124918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.128314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 226/450] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/groups/75723049a3744e92a477fb40c62d1f4e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:04.134947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.151391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.152949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.243293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.252306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0ac-8a7d-40ab-a549-b818bde50b0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.275668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 225/451] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:04.280972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.286011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.286664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.286947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.287225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.288056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] RBAC: Adding query filter params (group.id=75723049a3744e92a477fb40c62d1f4e, role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=5899564e4e184c388cec498d38b04051) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:04.288396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.290574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.296644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 227/452] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/role_assignments?group.id=75723049a3744e92a477fb40c62d1f4e&scope.project.id=5899564e4e184c388cec498d38b04051&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:04.334021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.388692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26bbd2-6079-4ef6-8e3a-ee9c2cfd771c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.424832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.425733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.426017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.426293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] PATH_INFO: `/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.427531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] RBAC: Authorizing `identity:get_project(project_id=4f9a6bdb9ae7447fb41cd2764e1194d4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.429000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.430812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 226/453] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/projects/4f9a6bdb9ae7447fb41cd2764e1194d4 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:04.436260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.544232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005c5-0308-42bf-a3b6-5ad62843dde5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.577165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.578052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.578331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.578630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] PATH_INFO: `/v3/groups/72fba2f90bdd4877908c9ca192aa1caa` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.579816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] RBAC: Authorizing `identity:get_group(group_id=72fba2f90bdd4877908c9ca192aa1caa)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.581202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335d808-7109-4a01-b3f7-7262dd0f9159 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.583016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 228/454] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/groups/72fba2f90bdd4877908c9ca192aa1caa => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:04.588881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.687137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d6942-c0b4-4803-a4cc-bc7111377f8c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.704151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.721162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.721838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.722125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.722406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.723229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] RBAC: Adding query filter params (group.id=72fba2f90bdd4877908c9ca192aa1caa, role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=4f9a6bdb9ae7447fb41cd2764e1194d4) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:04.723543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.724984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95837451-6689-4a5c-adaf-0fdb2b0281be None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.730795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 227/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/role_assignments?group.id=72fba2f90bdd4877908c9ca192aa1caa&scope.project.id=4f9a6bdb9ae7447fb41cd2764e1194d4&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:07.107948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0ff6-8be6-446e-a483-48f9a7ac2b8f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.108473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0ff6-8be6-446e-a483-48f9a7ac2b8f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.108548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0ff6-8be6-446e-a483-48f9a7ac2b8f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.110264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 229/456] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:07.115360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e67a-8b34-4582-9d55-9a2b9d97b4e1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.115787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e67a-8b34-4582-9d55-9a2b9d97b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.115958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e67a-8b34-4582-9d55-9a2b9d97b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.142382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8ff2e67a-8b34-4582-9d55-9a2b9d97b4e1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:07.143603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8ff2e67a-8b34-4582-9d55-9a2b9d97b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:07.238107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 228/457] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:07.270628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0ff6-8be6-446e-a483-48f9a7ac2b8f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.308788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.346696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4dcf-bf15-4366-8e70-e1a66709a43e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.347338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4dcf-bf15-4366-8e70-e1a66709a43e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.347836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4dcf-bf15-4366-8e70-e1a66709a43e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.349680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 229/458] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:07.355744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c253-a559-44e4-8f1c-98c3b8299f96 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.356257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c253-a559-44e4-8f1c-98c3b8299f96 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.356748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c253-a559-44e4-8f1c-98c3b8299f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.382255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fea8c253-a559-44e4-8f1c-98c3b8299f96 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:07.384354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fea8c253-a559-44e4-8f1c-98c3b8299f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:07.464751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0ff6-8be6-446e-a483-48f9a7ac2b8f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.504658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.505811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.506396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.506987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.520826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:07.520826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5151f3-43b4-414f-b4a0-674455d15bee None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.520826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5151f3-43b4-414f-b4a0-674455d15bee None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.520826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5151f3-43b4-414f-b4a0-674455d15bee None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.520826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 231/460] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:07.526693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.526986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.527273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.530355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.532192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.548257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:07.551674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:07.571901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:07.572862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:07.573746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:07.573746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:07.573746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.573746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:07.576491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 230/461] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:07.577653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.600128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.645787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:07.646722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.673339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.700010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f94a9-9ca2-4500-8f37-05f42086126c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.737524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.738311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.738589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.739065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.750217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.751677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:07.769599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:07.770491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:07.771318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:07.771318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:07.771318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.771318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:07.771318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:07.772045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.794770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719197ce-29a9-43e9-ae2c-40b9d8769573 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.832015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.833135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.833661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.834137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.835048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:07.836170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.837842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.850346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 233/464] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:07.852741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.877248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a0e3-664b-4505-9d7c-3b498a946079 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.887373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.909253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.915830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.916745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.917173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.917566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.928596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.930476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:07.948741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:07.949700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:07.950534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:07.950534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:07.950534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:07.950534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:07.955034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:07.955887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.968215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282595-8621-412d-adfa-988fb2bb657d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.005165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.006209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.006706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.007729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.008657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:08.009342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.010962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.024929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 234/466] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.026087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.062906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72c471-4ba0-412c-901b-a6f292773809 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.098678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.099347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.099628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.099906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.100824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.102753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.137404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 233/467] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:08.137404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.139992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.154405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c47ba-c45f-42a0-b0e8-f97c03044935 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.192065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.212607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.213838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.214383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.214867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.215827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:08.216392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.218293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50ca8-5c02-4250-b8f7-92044d3daf33 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.234418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.236260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5781-2a33-4082-ac16-c1c673cb9bd5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.236825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5781-2a33-4082-ac16-c1c673cb9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.237330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5781-2a33-4082-ac16-c1c673cb9bd5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.239365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 236/469] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:08.245724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.245724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.245724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.264174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:08.265671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:08.283839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8769a2-e5bf-44d8-8084-9df8d01c964c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.340824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.341522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.341804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.342080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.342782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.344314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.357008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 237/470] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:08.357817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.373570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 234/471] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:08.392320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.489641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.515532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41654b-5b9c-4f90-9315-129318356e26 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.550800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.558596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76999a0-569c-43be-9365-667c6fb5159f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.563322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.563994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.564314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.564592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.565358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.566965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a792-b113-464b-a246-c599ab9a50e8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.590642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 238/472] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:08.604974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3198-a25f-4aa6-9f08-39e852b7094c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.605263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3198-a25f-4aa6-9f08-39e852b7094c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.605586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3198-a25f-4aa6-9f08-39e852b7094c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.607557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 239/473] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:08.609824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.610662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.610949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.611329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.613197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.613770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.614243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.625560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.626277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.640816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:08.642395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:08.647377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:08.649058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:08.649935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:08.649935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:08.649935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:08.649935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:08.649935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 235/474] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:08.655839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.726658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 240/475] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:08.761855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.793206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b66e-2ae9-4a59-bc0e-14fd251d2ef1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.836981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.837753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.838042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.838324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.839137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:08.839447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.841104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.841424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.856461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 236/476] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:08.862599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.877562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.895960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21245-1b90-46d0-ae7b-9ce54a216961 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.937875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.938861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.939332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.939786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.940829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.942589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.958611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.sql.core [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:08.958611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:58:08.958611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [parameters: {'id': '9f84069a1b8842a4a2d508070c688503', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:58:08.958611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:58:08.973440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5f1a1-608b-419f-9ad6-f66a7c148cec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:08.978011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:08.978935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application yield resource Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise self.value Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application session.commit() Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:58:08.979824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:58:08.980717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:08.981592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:08.982400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [parameters: {'id': '9f84069a1b8842a4a2d508070c688503', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:08.983176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:58:08.983950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:08.987995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 241/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:08.994558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.011016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.011742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.012082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.012300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.013065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.014818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.044158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 237/478] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:09.155275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1812799-783f-4f8c-9ccb-cb164e6736e0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.188228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.195516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.196988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.197539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.198050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.209761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c2394a80-491d-468b-b59b-7284e48544ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:09.219327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:09.220278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:09.221042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:09.223879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 242/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:09.229296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.312453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.353840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d752-c7cd-4308-b47d-960a38c4426e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.390683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.391416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.391699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.391972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.392722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:09.393030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.394427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4112a9-a1b8-4f7a-9eeb-dc4f83e16f0d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.404324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 238/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.670305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc497b-93e5-4109-8ee2-44b302ed08bf None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.670812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc497b-93e5-4109-8ee2-44b302ed08bf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.670915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc497b-93e5-4109-8ee2-44b302ed08bf None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.672503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 243/481] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:10.677330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.677750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.677911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.701836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:10.703047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:10.791662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 239/482] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:10.827312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc497b-93e5-4109-8ee2-44b302ed08bf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.983146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc497b-93e5-4109-8ee2-44b302ed08bf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.028910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.029728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.030010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.030284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.043584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9c1449f8-2de4-401f-91d5-8ef901b3bdb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:11.052488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:11.053493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:11.054455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 244/483] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:11.062461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.102216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7fc6-5bdd-4b57-b1ef-882634647c38 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.102538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7fc6-5bdd-4b57-b1ef-882634647c38 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.102771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7fc6-5bdd-4b57-b1ef-882634647c38 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.104505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 245/484] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:11.110084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.110368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.110654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.127778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:11.129074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:11.154100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.202055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.228327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262ec6-c84f-4a80-a2f7-a1886ad520c2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.242963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 246/485] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:11.268237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.298166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.298887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.299126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.299403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.300161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:11.300472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.301877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.330368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 240/486] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:11.331946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.455018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229124e-f662-46a5-836f-80a25bb68acf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.493922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.494633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.494917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.495195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.495379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fdf0-e546-4873-99d1-5c447158b669 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.505854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3a8cd982-8070-45d9-a63f-c04b2eddf3c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:11.513811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:11.514672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:11.515834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 247/487] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:11.516716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee378-31ef-4c5a-bb53-7ca25a91f702 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.516716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee378-31ef-4c5a-bb53-7ca25a91f702 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.516716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee378-31ef-4c5a-bb53-7ca25a91f702 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.518249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 248/488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:11.520514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee378-31ef-4c5a-bb53-7ca25a91f702 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.522129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.549635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.550848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.551487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.551864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.566478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.568038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.573278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a4ccb90-6b30-449e-92b3-fed3ef967a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:11.590550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:11.591446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:11.592318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:11.592318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:11.592318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:11.592318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:11.594341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:11.595650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.596059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.596457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.614779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:11.616462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:11.643677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee378-31ef-4c5a-bb53-7ca25a91f702 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.681919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.683297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.683764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.684211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.685152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:11.685722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.687226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.701265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 249/490] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:11.702290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.704039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 242/491] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:11.712101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.822155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.825193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85cc2-f990-48de-954b-68ae47e288d4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.826109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a1a5-a55e-4e6f-a6ba-0957b0210888 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.827899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.861720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.862057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.862508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.862689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.862806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.862956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.863046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.863214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.863926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:11.864231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.865911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.873564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.875005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.881488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 250/492] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:11.881488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8b2bce53-d2ea-4f3f-aedb-127f3dc059dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:11.894760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:11.895793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:11.896652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:11.896652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:11.896652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:11.896652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:11.896652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 243/493] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:11.897163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305273-26bf-4e57-be34-02133ff6eae7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.897464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305273-26bf-4e57-be34-02133ff6eae7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.898287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305273-26bf-4e57-be34-02133ff6eae7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.899657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 244/494] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:11.900191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305273-26bf-4e57-be34-02133ff6eae7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.988975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3687a-de5c-48a2-bded-cdf6a4756061 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.008073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305273-26bf-4e57-be34-02133ff6eae7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.026422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.027417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.027846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.028402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.040004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:12.042119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee780-e385-404f-a00e-255f36015070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.042907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee780-e385-404f-a00e-255f36015070 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.043192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee780-e385-404f-a00e-255f36015070 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.043469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee780-e385-404f-a00e-255f36015070 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:12.048232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.049119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:12.050201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:12.052819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ee780-e385-404f-a00e-255f36015070 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.055633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ee780-e385-404f-a00e-255f36015070 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.055757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 251/495] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.056247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-518ee780-e385-404f-a00e-255f36015070 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:12.071928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.072919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:12.074566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 245/496] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.075111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.075111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.075231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.088334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.091745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:12.092948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:12.100539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.161763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 246/497] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:12.162602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.182616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e624b-7e04-42b4-9e31-82bb2ce2542a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.218116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.218778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.219064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.219342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.220054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.220366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.221800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.234055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 252/498] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.234851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.264647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0898e-2cc5-4a5f-b311-7f93f77d077a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.299312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.299969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.300244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.300517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.301249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.301583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.303017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2d53-0e69-43aa-834a-b029ed9648f0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.312341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 247/499] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.312739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932707-b0ff-453e-a227-61e0f42fb327 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.313026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932707-b0ff-453e-a227-61e0f42fb327 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.313298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932707-b0ff-453e-a227-61e0f42fb327 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.314559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 248/500] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:12.315461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932707-b0ff-453e-a227-61e0f42fb327 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.319207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.326149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.346074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59593a-0ac0-4670-a3cc-d7031f3a4287 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.381284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.382011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.382790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.383061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.383880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.384186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.385665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.420638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932707-b0ff-453e-a227-61e0f42fb327 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.421063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 253/501] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.421918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.455235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.456018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.456301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.456644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.467284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:12.474904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.476450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 249/502] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.482109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.524087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a909-db63-4a04-9908-96f10ebb4148 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.539673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.558967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.559755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.560044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.560328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.567289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.568748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.576989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896c92f-c678-446d-9955-bd5e5be86e18 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5e02b389-3850-4c70-ae8f-f8e7dc6a35e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:12.584443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 254/503] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.591876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.592705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.592705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.605633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:12.606851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:12.618188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.618978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.619260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.619534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.629950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.631423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:12.649788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.650654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.651478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:12.651478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:12.651478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:12.651478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:12.653521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 250/504] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.654520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.673405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 255/505] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:12.674323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.755123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837be8-ab12-484a-8cd9-4f5b8a2caf20 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.771140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc887f2-8f0d-463a-80db-d620b443b70d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.771794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.790488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.791122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.791401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.791672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.801558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.807362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.808024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.808308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.808587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.809331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.809672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.811075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.819390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 256/506] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.820827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.864536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.865933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.920921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c628a4-1d1a-4760-b44f-374270a3059f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.953571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.954222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.954504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.954774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.955584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.955889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.957359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.961832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 251/507] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:12.962655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.979550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 257/508] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.979550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.986452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.031611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.067857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3de000-cbaf-4b98-b650-e404b45cda41 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.079826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec146d57-036a-462d-a95c-064340c1d15a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.101316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.101990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.102267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.102542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.103257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:13.103557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.104977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.113913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.114736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.114966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.115236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.115677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 252/509] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.116961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.130876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.133133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:13.151332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:13.152196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:13.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:13.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:13.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:13.153025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 258/510] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:13.153413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.202610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.224745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a877d3-87ff-4c19-890f-b188737e8bc9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.250910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b47011-90fd-4cc3-b3f0-ab0961a23f6e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.253291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.260438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.261228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.261545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.261881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.272346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.274171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.286194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.286975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.287260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.287538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:13.291186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:13.292161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:13.293084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:13.293084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:13.293084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.293084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:13.293084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 253/511] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:13.293447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.298528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.300001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:13.322326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:13.323367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 259/512] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:13.324432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.400231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8a78-fb50-45ac-953d-1d8908086d37 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.423817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf059-601e-4132-bf5c-7a1fa234056a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.425073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.434559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.435200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.435483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.435757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.458804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.459590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.459872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.460418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.467548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.469014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:13.483365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:13.484399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:13.485260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 260/513] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:13.485851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.502995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.508812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.510329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.586758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb727-6e75-4e40-9992-c7447dd02433 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.605431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 254/514] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:13.606251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.624563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.625219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.625537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.625815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.626524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:13.626836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.628224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.632930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.639850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 261/515] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.640632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.707249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc610d-4988-4a36-8cd7-5670cd2a70b6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.718040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.742184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.742839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.742976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f68ce-fc7e-405c-97fb-a833501619a6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.743117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.743391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.744100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:13.744405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.745788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.756725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 255/516] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.757605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.777246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.777938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.778223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.778500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.779211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:13.779515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.780962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.793468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 262/517] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.794250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.846308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.859457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce484c3-eb0b-44d2-98f2-cbbd7663b77a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.891846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.892505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.892784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.893055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.893937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:13.894109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb701e-d89b-4301-a5fa-63bf9391ffa2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:13.894247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.895669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.928411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:13.929678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.929966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.930244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.932896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.933310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 256/518] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.934184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:13.942068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:13.943524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:13.961764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:13.962593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:13.963483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:13.963483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:13.963483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:13.963483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:13.963483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 263/519] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:13.963740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.036992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179671-94e8-4584-8a7e-f15695b14a36 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.060168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e62f-2535-40f5-8be7-44efeda2eeeb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.071362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.072023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.072303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.072576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.073273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.074755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.093833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 257/520] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:13 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:14.094624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.094814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.095610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.095870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.096141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.105192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.107131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.112056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:14.124251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.125256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:14.126165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 264/521] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.126728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.187119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.220544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39220-493d-4912-80c2-ccf42e5f0b08 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.245535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd06e-607c-4eeb-ab9d-1b297a3e98bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.262529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.263335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.263623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.263904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.271039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.272519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:14.289464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.290350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:14.291185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 258/522] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.291646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.293513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.294167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.294449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.294721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.362083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.375892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.377554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.405819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8391-0efd-49c1-a32b-4ebfe99c512d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.427917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.445212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.445765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.446144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.446514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.447336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.447712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.449189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.463320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 259/523] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.464286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.489811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 265/524] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:14.490878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.575029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e775-796c-4b23-82b2-26b1ee6c8019 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.596042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339150-1991-4edc-a87d-f4406276e746 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.598979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.613878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.614544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.614823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.615097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.615934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.616372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.617882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.634770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.635530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 260/525] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.635638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.635800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.636039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.636937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.637247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.638714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.640737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.657707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 266/526] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.658518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.670216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.757606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607903-134b-4622-bcd4-87d50f0bb73f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.764578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f06520-d204-499e-96d0-cf1c65b86b16 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.794930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.795827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.796113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.796387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.802606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.803167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.803395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.803703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.804506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.805668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.815490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.816945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:14.820253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.821115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 261/527] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.822276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:14.842100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.843078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.843892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:14.843892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:14.843892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.843892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:14.843892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 267/528] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.844588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.872173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.911643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.939011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb449-86f0-4423-a3db-ea24b2b04600 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.955843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058977ca-ff3b-48b0-aa47-b62ca6b257d9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.973878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.974517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.974794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.975063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.990801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.992100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.992551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.992626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.993479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.993800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.995260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.000900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 268/529] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.006520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.051326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.053315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.099204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.138235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3572e-dc24-422c-a4c2-81955cc80de2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.166798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.167494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 262/530] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:15.168807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.180549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.181271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.181595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.181894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.182924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.183245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.184711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.200481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 269/531] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.201578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.296233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b39774-3474-4610-ba7e-91a4f8e0bf33 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.334824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1414-dd3e-415b-8472-be75353c1c5d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.349881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.350546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.351382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.352016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.352379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.352685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.354095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.362842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.368675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 263/532] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.369581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.379641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.380822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.381305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.381808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.393720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.395473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:15.416359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:15.417221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:15.418110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:15.418110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:15.418110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:15.418110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:15.420122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 270/533] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:15.421101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.461798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.482388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adea25-ea15-4ffd-9e56-609e027ac997 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.519904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.520590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.520875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.521155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.522027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=6bee578760b649d7a8fc07d5e9770746) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.522343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.524805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.534056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 264/534] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/role_assignments?user.id=6bee578760b649d7a8fc07d5e9770746&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.534932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.536460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc76c7-e1a7-4b4a-bff7-4c5017ef6ea5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.576842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.578120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.578611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.579111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.588286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.590131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:15.611793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:15.612697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:15.613970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:15.620154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 271/535] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:15.625970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.689397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.769762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.779462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b644-5a2c-4287-ac75-639d8c3b0d85 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.781014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fabd6-aadf-4519-b2a3-5215c5a760db None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.824089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.824887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.829399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.829399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.829399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.829399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.829399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.844659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 265/536] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.850457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.860212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.866172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.868358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.868808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.869793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.871269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.872884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.899223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:15.905070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.021513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906b3d-8e2b-4a71-b967-9bb8f60e11a5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.042230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.060511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.061675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.062899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.063378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.076138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.077635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.083250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb191a9-878a-49fd-bfd9-308f204abc38 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:16.107954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:16.108795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:16.109687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:16.111613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 266/538] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:16.114557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.159744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.160437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.161746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.162039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.162876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=819e7ece10414befa043f4b84da6c1f9) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:16.163260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.165427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0959-9c24-4e1b-a88d-0d10b5783c94 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.176853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/role_assignments?user.id=819e7ece10414befa043f4b84da6c1f9&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:16.239465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a4ee-5605-4b65-b588-67ef69bf1cbf None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.239820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a4ee-5605-4b65-b588-67ef69bf1cbf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.240024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a4ee-5605-4b65-b588-67ef69bf1cbf None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.242947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 274/540] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:16.257708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.258614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.258906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.273844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a9feb-db37-4ce5-9a82-3ae67ca399ec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.292651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:16.293989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:16.320658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.320658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.320658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.320658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.321042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:16.321042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.321442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.335801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.345644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 267/541] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:16.354553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.432154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 275/542] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:16.437399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.461354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.494700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1446-1479-4497-9c2d-bc1000a56f0e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.531784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.532437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.532720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.532999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.535396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=de74d94d77fd4220a976184b587f389e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:16.535712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.537163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.554437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 268/543] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/role_assignments?user.id=de74d94d77fd4220a976184b587f389e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:16.630542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de978a45-e5c4-4a4e-bb5f-ff07a9aef1aa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.676345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.677163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.677465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.677741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.694281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:16.703528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:16.704489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:16.705269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 276/544] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:16.712532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.830831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bebe-9e8d-474c-b1c9-c80c74fa2883 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.842359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.870135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.870805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.871084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.871360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.872230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:16.872579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.874107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.883874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 269/545] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:16.890467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.907689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.036502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579239be-7b84-4d7d-a6cc-6ac67135f67b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.083989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.084833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.086244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.086539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.100358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:17.103002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0b6ab3df-8afa-4693-b0ba-f01f13682679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:17.126144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:17.127006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:17.127843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:17.127843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:17.127843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:17.127843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:17.127843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 277/546] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:17.133000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.292215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6970e8-57e5-4849-b3dc-971708068280 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.359476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.360143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.360428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.360705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.361458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:17.361767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:17.363145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:17.370919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd950f-527a-40b5-b57c-ef02a4e5b62d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.371204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd950f-527a-40b5-b57c-ef02a4e5b62d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.371483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd950f-527a-40b5-b57c-ef02a4e5b62d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.372990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 278/547] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:17.385134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.385451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.385734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.389596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 270/548] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:17.395784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.416638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:17.417875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:17.462006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.541733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.566921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 279/549] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:17.581899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63f5f-34bb-45a5-8c5e-59520f53d5f0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.627001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.627807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.628085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.628559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.638881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.643633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:17.646167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:17.662152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:17.663618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:17.664691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 271/550] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:17.674315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.761859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79efd-743f-4f8f-a9c0-98d7c96bd55b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.810686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.811861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.812353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.812857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.822043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7eebd-3043-4ea4-b9a8-9d05def3157e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.835624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:17.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:17.853096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:17.853938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:17.861234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.861234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.861234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.861234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.861944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:17.861944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:17.861944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:17.862352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:17.863424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.880568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:17.885329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.886820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.960758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.025491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703330fe-f716-4aae-a8e3-6564e93d2af2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.027940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c57c5-16f3-42db-b454-9fa84dc8b66a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.067098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.068095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.068654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.069197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.072772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.073400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.073716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.074851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.075619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.075932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.077337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a692-2cfa-48a1-8638-32c4ff8cab38 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.092342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 281/553] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.092342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c846a-4a5a-4367-a48b-81f354980ca5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.092342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c846a-4a5a-4367-a48b-81f354980ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.092342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c846a-4a5a-4367-a48b-81f354980ca5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.092342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 282/554] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:18.096012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.096754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c846a-4a5a-4367-a48b-81f354980ca5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.168685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.170920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3473b9-8599-423c-ac24-f03161422d55 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.222156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c846a-4a5a-4367-a48b-81f354980ca5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.240727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.278130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.279091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.280704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.281061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.296803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.299064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.312498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 273/555] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:18.315019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f319-d24c-453a-8875-919c795952b3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.315506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f319-d24c-453a-8875-919c795952b3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.316053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f319-d24c-453a-8875-919c795952b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:18.325336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.326234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.327094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:18.327094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:18.327094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.327094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:18.331604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 283/556] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.332712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.338868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4939f319-d24c-453a-8875-919c795952b3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:18.340290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4939f319-d24c-453a-8875-919c795952b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:18.387555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.421141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 274/557] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:18.422433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939f319-d24c-453a-8875-919c795952b3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.449115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68f38-250f-4339-b86a-c92a0158fcee None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.486498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.487298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.487579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.487856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.500265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.501950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:18.520311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.521746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 284/558] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.524158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.548860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.549353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939f319-d24c-453a-8875-919c795952b3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.595194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.596249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.596725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.597194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.598138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.598677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.600244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.618706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 275/559] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.620038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.641321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954458f4-c689-4544-a5f0-5a12cd5efc19 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.662961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.682257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.683380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.683830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.684353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.696040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:18.704752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.705782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.706604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:18.709455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 285/560] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.711060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.734119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e29f9-479b-4112-bc11-d30b49532012 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.769469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.770133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.770413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.770689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.771412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.771715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.774026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.790533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.790533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.812102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.844840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0604f0-e1cf-4bcd-971e-304ed49ca8b5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.883311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.884484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.884771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.885046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.892560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.895140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.896657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.896781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8994-c755-43e4-b78b-a7dddfd811ff None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:18.913276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.914561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 286/562] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.915490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.939943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.940916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.941199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.941510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.942256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.942560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.943936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44c64-c847-4b3e-b737-349526a0d5f9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.952509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.953864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa02-afa0-4c47-ba68-c69759bc870e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.954150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa02-afa0-4c47-ba68-c69759bc870e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.954424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa02-afa0-4c47-ba68-c69759bc870e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.957413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 278/564] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:18.957413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92aa02-afa0-4c47-ba68-c69759bc870e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.018992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fe34c-d7f5-420c-93de-3037acf107ca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.055200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.055984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.056264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.056534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.059073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92aa02-afa0-4c47-ba68-c69759bc870e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.063121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.064561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.066274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-dbb947b5-7aec-4b3f-8f2b-64220cff07bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:19.080039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.081074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:19.082207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 287/565] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.082679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf77-6d27-4654-a789-bd07e244e21c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.082679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf77-6d27-4654-a789-bd07e244e21c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.083082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf77-6d27-4654-a789-bd07e244e21c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.084198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 288/566] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:19.084903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bbf77-6d27-4654-a789-bd07e244e21c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.098893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.099564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.099861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.100118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.101032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.101340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.102812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4591f-32f3-4be6-b8a9-8aa8a83b1f3c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.121164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 279/567] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.122442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.122713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.122989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.139101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:19.140234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:19.153615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.195520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bbf77-6d27-4654-a789-bd07e244e21c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.206766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 280/568] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:19.207585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.229675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.230470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.230755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.231035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.242084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.243673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fa349286-beab-416a-8799-b9479db0dbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:19.261239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.262259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.263114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:19.263114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:19.263114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.263114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:19.263114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.263620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.263919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.264162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.280715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:19.281941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:19.323864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ad53-dc1d-4033-9a25-826d94ab2298 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.329659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.352063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 290/570] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:19.353151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.360829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.361528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.361819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.362100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.362895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.363205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.364629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.377089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 281/571] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.377926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.392209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.454843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e379c-e629-493b-a9c6-8c7fc10558f9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.481257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8347e-2ad7-4a84-b00b-2264509cb4bd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.489191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.490006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.490294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.490573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.501040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.502566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.517322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.518136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.518418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.518696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:19.520577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.521604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 291/572] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.523088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.533006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:19.541489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.542409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:19.543233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 282/573] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.543903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.559715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.608259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.628825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89643efa-4f1f-4e6a-8ed9-625c8a78f8ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.642514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031f918-e584-4e80-8cb3-4d4d31f6cb47 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.662665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.663829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.664107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.664375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.665077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.665396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.666791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.675657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.676437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.676717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.676994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.677869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 292/574] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.678671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.688355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:19.696649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.697790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 283/575] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.698647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.776118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.784962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba09ce9-62e4-4e45-ba76-3ea98e74561f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.797005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050c564-516d-4e34-952b-ccf0a1818016 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.818072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.818719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.819006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.819308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.820257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=573c370fec404be39c9a21fbafd43a4e) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.820568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.822049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.823081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.827733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 293/576] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/role_assignments?user.id=573c370fec404be39c9a21fbafd43a4e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.828501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.841064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.841783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.842068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.842345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.843090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.843399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.844816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.858309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 284/577] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.859177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.946614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664f788-3d12-45ca-be2a-522b75746e8f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.972884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270cf4-8a5f-4543-acc5-01cdc9564518 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.985679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.987032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.987032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.987032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.987781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.988149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.989959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.999627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 294/578] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.000437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.015009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.015798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.016078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.016347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.024375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.025525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.025971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:20.040809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.041974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:20.042927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 285/579] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.043497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.097301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.133448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e615a7-ce8f-415f-a0e3-66c63ee39f98 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.156460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a22e33-66a7-4f10-8f67-41f967b5b259 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.167270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.168067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.168428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.168709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.169480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.169791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.171163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.179787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 295/580] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.180597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.199311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.200004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.200286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.200562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.207534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.208874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:20.222506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:20.224773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 286/581] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.225279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.277738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.298921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411455-07d3-461a-a586-9135ef334c6d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.342140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cf0a-e259-4087-b5dd-ee230cc20608 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.343098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.344013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.344389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.344772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.352371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.358570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.360269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.378621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:20.378792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.379663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.380554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:20.380554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:20.380554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.380554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:20.380769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.380769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.380769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.380769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.381015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.382594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.384691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 296/582] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.386059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.405329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 287/583] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.405329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.499163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d91-dae4-4dd9-85eb-beca84b17e22 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.510212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dd831-e601-4400-86f7-71d5eed415bf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.530253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.535787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.536581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.536866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.537139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.547574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.548231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.548508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.548747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.548847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.549577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.549881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.550252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.551285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.568339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 288/584] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.568339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:20.568618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.570564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 297/585] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.571443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.602809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.687957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf017-6f76-4f9e-a477-9168aafb20c6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.692845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d92217-ec71-487c-9d53-a8af7df598c4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.723636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.724320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.724597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.724884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.725723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.726038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.727407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.730375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.731369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.731827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.732276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.739164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.739928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.749835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.751568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:20.770890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.771772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.772670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:20.772670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:20.772670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.772670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:20.774837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.775808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.815658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.834940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.851790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f8f1d-0e03-4c5c-a8ac-3f9e1e881b7a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.889211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.890144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.890431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.890710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.892947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9b8a-ce79-4d8c-ab89-35eae78fec91 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.908693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=115ba46eabce4863a597ad69bca1703c, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.910202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.924999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 290/588] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:20 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:20.926075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.947031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.948464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.948955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.949776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.951247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.951759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.953485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.973665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.974956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.051650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc37b5b-877c-441b-83bb-2ce48df290e4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.091114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.091914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.092200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.092482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.092892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.096052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.099189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af926b7-3792-4bb7-a9fe-24c008b50dbb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.102060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.103697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:21.120827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.121911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:21.122830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.124045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.148637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.149300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.149622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.149897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.150615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.150916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.152283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.167032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.167933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.251677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277a7c-f413-450d-bf88-af5aea2f85ac None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.294530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be200-129a-41fb-9094-9691648bd8dc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.295643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.296837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.297851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.298043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.315636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.317033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:21.338069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.339027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:21.339952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:21.343914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.344836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.347700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.348841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.349403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.349887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.351030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.351550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.353200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.373634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.375003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.392257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.407731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.457474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485802f-2957-4fee-974f-9a38d53c3260 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.495714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b43f0-2a99-45aa-a5c4-eaa2e20bcf37 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.505830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.508023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.508536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.508955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.518621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.520815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.538138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa488-e623-438f-9176-953fb0757428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.539027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa488-e623-438f-9176-953fb0757428 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:21.539394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.540321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:21.541186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:21.542081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa488-e623-438f-9176-953fb0757428 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.542535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa488-e623-438f-9176-953fb0757428 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.543528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa488-e623-438f-9176-953fb0757428 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.543996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa488-e623-438f-9176-953fb0757428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.545742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 293/594] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.546057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa488-e623-438f-9176-953fb0757428 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.546727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.570676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.571823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa488-e623-438f-9176-953fb0757428 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.655458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.671207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29351254-2c5f-4ae5-8eca-28ed3f46292d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.691232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.699384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa488-e623-438f-9176-953fb0757428 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.713182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.714109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.714728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.714838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.727693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.729257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.744194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.745138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.745632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.746109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.747061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.747542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.749144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:21.749669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.750502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.751560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:21.751560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:21.751560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.751560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:21.751560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.752542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.766994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 303/597] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.768296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.878599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bdb5f-9274-4381-912b-3c5f9de7a631 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.883080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74357d-b036-4632-82d3-2f4642a692c4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.915044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.915362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.916152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.916432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.916731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.921060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.921954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.922520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.922975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.923876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.924255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.925684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.928039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.930205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.942977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 304/598] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.942977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9d228eb7-c1bc-4c88-a5d1-4541ba78187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:21.947804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.948670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.950001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:21.950001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:21.950001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.950001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:21.950001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 295/599] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.950594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cbd0-f36e-4219-92b2-33a5b0407b78 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.950874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cbd0-f36e-4219-92b2-33a5b0407b78 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.951146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377cbd0-f36e-4219-92b2-33a5b0407b78 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.956842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 296/600] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:21.956842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377cbd0-f36e-4219-92b2-33a5b0407b78 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.978602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.052579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842edc39-fb89-43c6-8e39-14d177d7109f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.071005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377cbd0-f36e-4219-92b2-33a5b0407b78 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.088284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.089168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.089480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.089748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/6bee578760b649d7a8fc07d5e9770746/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.107444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=6bee578760b649d7a8fc07d5e9770746, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.108933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.109821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.110615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.110899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.111177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.119889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.121625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.133620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 305/601] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:21 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/6bee578760b649d7a8fc07d5e9770746/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:22.133620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-232158dd-a736-45c4-9b2a-05c3cd876f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:22.136105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.136987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.137913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:22.144158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 297/602] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.145674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.145956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.146701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.169545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:22.171290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:22.191962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.265527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 298/603] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:22.266800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.289485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.297899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa450-7a21-4ab7-a831-2a8b72503999 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.351144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.352057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.352488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.352910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.353817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.354295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.355856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.368846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.369962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.412284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfec0cb-c22c-4644-81c2-e13b4d4ccc3e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.450912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.451997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.452553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.453029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.454269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.454800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.456442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.469847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 299/605] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.476188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.499880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ab0f-e506-4f3b-8b0d-b06258891cdc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.501490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.549302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.550246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.550527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.550846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.561397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.566801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:22.575541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.576465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:22.577280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:22.581717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 307/606] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.582505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.605002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2e97-e65a-4dd9-ad49-2044d430ec03 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.652571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.653433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.653715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.653985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.661946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.664049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:22.680396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.681343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 300/607] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.682353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.698323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ae53-8a20-4099-91b4-77bad09a7369 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.741758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.742577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.743051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.743395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/819e7ece10414befa043f4b84da6c1f9/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.759714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=819e7ece10414befa043f4b84da6c1f9, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.761282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.785481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 308/608] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:22 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/819e7ece10414befa043f4b84da6c1f9/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:22.786707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.815496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.831195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4851d-6331-42d3-9c26-4a1ced31c10e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.890033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.900508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.901221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.902787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.903071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.903853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.904160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.905586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.915709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 301/609] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.921317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.000766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ce44-3066-4395-a019-3e03d798bcaa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.051837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.052824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.053009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.053242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.054957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:23.055359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.056972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927bd26-c3ac-4801-846a-4d74c4211352 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.073434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 309/610] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:23.073434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c5c6-0f6b-460a-9cfc-6599b58828b0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.073434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c5c6-0f6b-460a-9cfc-6599b58828b0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.073434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c5c6-0f6b-460a-9cfc-6599b58828b0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.073809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 310/611] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:23.076284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c5c6-0f6b-460a-9cfc-6599b58828b0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.086065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ccaa-91af-4bd2-b082-b6782600f094 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.126159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.126953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.127231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.127504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.141298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.143337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3ed25e1a-59f5-4098-90da-3b269ecf1b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:23.166905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:23.167791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:23.169074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:23.169074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:23.169074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:23.169074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:23.169074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 302/612] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:23.173668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.174920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.175398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.175691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.201610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:23.203893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:23.215125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c5c6-0f6b-460a-9cfc-6599b58828b0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.259913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.276225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.277652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.278242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.278694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/de74d94d77fd4220a976184b587f389e/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.290840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 303/613] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:23.292167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.300520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=de74d94d77fd4220a976184b587f389e, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.302746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.328825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 311/614] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:23 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/de74d94d77fd4220a976184b587f389e/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:23.337409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.411736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f796-010b-479c-ada2-561dfffb2ead None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.467261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.467855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.468135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.468405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.469132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:23.469457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.470843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.502350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:23.507473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.543022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0df89-60f8-48be-a1ee-cfc13857c53b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.577606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.588684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.609081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.610224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.610894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.611697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.626142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:23.638484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:23.639443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:23.640274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:23.643855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:23.650928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.669617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f94564-0df4-4d35-957f-94e0dc255da2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.746165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881b94-976f-48b2-add6-d83352120aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.747302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881b94-976f-48b2-add6-d83352120aae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.749401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881b94-976f-48b2-add6-d83352120aae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.749946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881b94-976f-48b2-add6-d83352120aae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.769035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89881b94-976f-48b2-add6-d83352120aae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.771044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89881b94-976f-48b2-add6-d83352120aae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-89881b94-976f-48b2-add6-d83352120aae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:23.801753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:23.802734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:23.804206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:23.809085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 305/617] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:23.822912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881b94-976f-48b2-add6-d83352120aae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.854953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f067bb-e923-4a99-b65c-ebd5778f7de5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.911383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.912497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.913028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.913608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.914597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:23.915103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.916679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.925905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 313/618] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:23.932285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.969599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.973879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881b94-976f-48b2-add6-d83352120aae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.035594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.049497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.050171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.050459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.050738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.051633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.051950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.053403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.084641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 306/619] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:24.090263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.139536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b5a7b-53db-4159-ad3f-ae6214c8d5ff None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.205770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.206567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.206852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.207125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.229541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.231020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-bf1cf71d-0b56-44a4-af20-6c5cbc44e608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:24.256580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.258401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.259581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:24.259581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:24.259581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.259581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:24.259581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:24.259934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29676f-43d0-408c-ae77-28e0d100c5b2 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.260125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29676f-43d0-408c-ae77-28e0d100c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.260403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29676f-43d0-408c-ae77-28e0d100c5b2 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.269412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 315/621] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:24.269412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29676f-43d0-408c-ae77-28e0d100c5b2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.278794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c64f-e248-4cc2-bd5d-6786e6e95bef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.334600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.336509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.336938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.337663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.350492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.352889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9d5fe0b9-83e4-4b81-9cda-806c5242cff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:24.375163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.376078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.376948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:24.376948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:24.376948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.376948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:24.379457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:24.380788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.381222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.381680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.390452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.403864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:24.405068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.405610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:24.414342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29676f-43d0-408c-ae77-28e0d100c5b2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.456778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.457558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.457916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.458586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.459104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.459499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.461036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.477661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 316/623] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:24.478658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.497414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 308/624] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:24.497414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.619179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb9be-38e6-41c1-ac5f-8ca2c1680535 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.637174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569516d0-3d1e-4a53-b837-afa55f20cb8d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.655527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.656132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.656419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.656700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.657675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.657797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.659127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.676525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 317/625] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:24.676525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.687198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.688133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.688825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.688825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.691121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.698606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.699983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:24.716172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.717473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:24.718660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:24.719316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.720426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 309/626] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.721606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.815002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23cddf-5872-4787-ba2e-f817b6bef109 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.832657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13903-775e-4bf9-9ac6-3b3bc4ed22dc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.862245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.863861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.864532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.864964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.869095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.870088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.870432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.870803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.877817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.878438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:24.879516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:24.887681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.888812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:24.889851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:24.896694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 318/627] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:24.897113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.898497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:24.899354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:24.900716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.901459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 310/628] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.902402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.978334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.998156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.029567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c893ea-5ccd-4ff7-816f-2c68c0ad7783 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.030937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61603e9d-2f53-47da-9e5a-8e21a5b6087a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.070469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.071228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.071607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.071909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.072841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.073209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.075745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.076322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.077548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.078023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.078915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.079929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.080421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.082572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.090489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 311/629] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.090489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.108172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 319/630] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.109294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.212407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace0af-caad-451a-b6ea-14a4887762ae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.216668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e749-ef22-4d3a-a691-377463188e90 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.229877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.249615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.250270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.250549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.250821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.251599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.251903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.252526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.253313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.253448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.253626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.253909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.255919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.265777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 312/631] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.270785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.271468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.273914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7e1e25fd-3a51-41a6-a711-eff62d1ac963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:25.292594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.293605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.295055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:25.295055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:25.295055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.295055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:25.295055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.295354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e34b87-79a9-49ce-b919-cad22b0b6285 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.295981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e34b87-79a9-49ce-b919-cad22b0b6285 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.295981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e34b87-79a9-49ce-b919-cad22b0b6285 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.297303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 321/633] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:25.301704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e34b87-79a9-49ce-b919-cad22b0b6285 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.387654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63b2b6-5df7-4ff1-8e5f-2668d278ebc3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.419424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e34b87-79a9-49ce-b919-cad22b0b6285 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.426213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.426853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.427383 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.427383 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.455714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.456849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.457128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.457425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/573c370fec404be39c9a21fbafd43a4e/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.473098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=573c370fec404be39c9a21fbafd43a4e, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.474515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.475192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.497412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 322/634] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:25 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/573c370fec404be39c9a21fbafd43a4e/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:25.497412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.511510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.513168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da827d-9ebc-48c6-80ed-f8877ecaf05d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.543409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.644614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbc087-ae67-4ec3-bdbd-56af87c4298e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.646193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 313/635] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:25.648816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980027f-6d28-454e-96f7-9569017c004d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.649102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980027f-6d28-454e-96f7-9569017c004d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.649390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980027f-6d28-454e-96f7-9569017c004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.668489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b980027f-6d28-454e-96f7-9569017c004d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:25.669836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b980027f-6d28-454e-96f7-9569017c004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:25.690804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.691906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.692206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.692489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.693531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.693852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.696389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.709636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 323/636] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.713422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.748146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 314/637] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:25.749423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e1356-60d9-4155-950f-2a3af108c1ed None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.749712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e1356-60d9-4155-950f-2a3af108c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.749989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e1356-60d9-4155-950f-2a3af108c1ed None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.755519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 315/638] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:25.755519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e1356-60d9-4155-950f-2a3af108c1ed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.769436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.822265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.829749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620d5b-2cb4-4547-a1f2-34dc324e386b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.865403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.866908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.867267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.867743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.873448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e1356-60d9-4155-950f-2a3af108c1ed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.878639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.880211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-86e59e0c-261b-4dd2-b665-dc26144416f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:25.898653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.899809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.900755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:25.900755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:25.900755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.900755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:25.900755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.901784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.902069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.902349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.915231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.916098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.916443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.916787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.919381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:25.920605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:25.924974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.926514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:25.941480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.942625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:25.943642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 316/640] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.944305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.999008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 325/641] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:25.999598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.023388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.061012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b144d-64e5-4e84-bfad-0c11bf634255 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.086830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.099402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.100306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.101294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.101294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.109681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba390dfd-31e1-44e4-b6e9-1c4bbec295ac None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.112141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:26.120580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.121605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:26.122474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 317/642] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.123166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.151936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.152597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.152878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.153153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.153896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.154197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.155564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.171681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 326/643] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.171681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.233679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94a4df-5a9f-4cef-9ce3-b4d172c29c42 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.260078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.268684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.269453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.269806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.270163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.271073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.271462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.273279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.284934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af4df-f8f5-45a9-8c12-cd5ea7270b23 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.296394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 318/644] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.296394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.331624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.332491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.332839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.333248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.340478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.345108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:26.353714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.354838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.355981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:26.356946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 327/645] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.357480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.421429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc4c6e-a5da-4570-a2db-83f9cb279484 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.458128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.458791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.459068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.460662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.461442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.461754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.463113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.471049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 319/646] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.471822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.486607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7539162-0442-4ad4-a1b6-c1acdb08ed6c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.520982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.526417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.527187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.527466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.527735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.534946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.536912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:26.550457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.551517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 328/647] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.557614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.585796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0fb41-021f-4d4a-ba86-2bca8792dda0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.616574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.624670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.625324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.625644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.625926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.663627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2168-b4c9-4845-af00-e9852c6701cb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.699426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.699929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.700105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.700369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.700644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.701411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.701508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.701719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.703070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.716616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 329/648] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.716616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.757362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.820179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 320/649] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:26.820935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.826756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcab2-4c69-4e81-965e-d524cb05e700 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.847512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.862368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.863146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.863961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.863961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.875159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.876762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:26.894560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.895587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.896699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:26.896699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:26.896699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:26.896699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:26.900581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 330/650] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.901218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.939106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bc57-f9ea-40ec-987d-57371a021751 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.974986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.975678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.975966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.976238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.977032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.977340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.978795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.995418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 321/651] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.995418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.003223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.003620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baebb97-baa0-42c0-855a-22aedd805629 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.041652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.042439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.042728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.043031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.055370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.056862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:27.074805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.075700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.076578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:27.076578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:27.076578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.076578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:27.076578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 331/652] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.076860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.107621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.108128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fc9fd-299c-40a9-bacb-8979bbd32064 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.144080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.144865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.145141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.145442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.156462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.157933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:27.175524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.176672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 322/653] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.182848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.195792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178678-b159-4a65-b7cf-d31674e825a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.232358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.233144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.233456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.233765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.234562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.234875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.236258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.242928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.252064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 332/654] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.252959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.295870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388728-8b5d-4668-9dd4-04505ef9d57c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.338772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.339430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.339712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.339990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.340822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.341134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.342620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.345511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.349796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 323/655] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.351900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.373259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6f57f-4d25-4747-ae13-596eaf7a4d89 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.416089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.416982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.417368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.417775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.418653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.419287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.420839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.435663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 333/656] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.436753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.502790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04c264-adc3-4116-ad08-bdc927526ef7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.533186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.544434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dedda-365f-408e-a034-19f158a55035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.545103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dedda-365f-408e-a034-19f158a55035 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.545394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dedda-365f-408e-a034-19f158a55035 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.545682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dedda-365f-408e-a034-19f158a55035 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.546404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dedda-365f-408e-a034-19f158a55035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.546712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dedda-365f-408e-a034-19f158a55035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.548153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dedda-365f-408e-a034-19f158a55035 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.563334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 324/657] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.564014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dedda-365f-408e-a034-19f158a55035 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.567461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5de8-9980-4833-bb7c-45a1bf685a2f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.611231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.612674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.612674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.612674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.622028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.623383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:27.641309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.642448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 334/658] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.643465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.648936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.691285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dedda-365f-408e-a034-19f158a55035 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.729672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.730579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.730862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.731236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.738834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.740504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.750455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5793c-665f-4b78-a645-a771f56b22ad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-01caa7a0-809f-4195-ade2-7e365e14511f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:27.756131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.757941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:27.758997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1adf-eeb8-4392-8844-eba69caa41b9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1adf-eeb8-4392-8844-eba69caa41b9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1adf-eeb8-4392-8844-eba69caa41b9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 326/660] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:27.766778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a1adf-eeb8-4392-8844-eba69caa41b9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.787389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.788202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.788485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.788973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.795776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.797244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ea768c3b-a1df-40a1-881d-2feb61f29bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:27.811610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.812665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:27.813807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 335/661] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.814371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.814663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.814938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.823124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.833238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:27.834879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:27.889495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a1adf-eeb8-4392-8844-eba69caa41b9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.896104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.906459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 336/662] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:27.918269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.930672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.931515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.931893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.932266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.933208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.933678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.935200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.954609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 327/663] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.955426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.035765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f71b1-cef2-41ef-ab66-2024ff7ebb42 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.059076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.062575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574778-0976-4337-a9b5-fb6965b7e8c3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.076620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.077317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.077589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.077865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.078687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.078990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.080417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.098703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.099366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.099649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.099924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.101245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.101687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.103443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 337/664] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.103550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.104237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.120401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 328/665] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.120401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.166397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.218502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8df77d-b3b2-4627-b529-a55439698674 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.221714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5586a-a4e2-48b7-8a52-2a542be7b19e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.257562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.258007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.258242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.258492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.258772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.258877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.259056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.259372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.269587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:28.277650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.278801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:28.279964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:28.283704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 338/666] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.284375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.290586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.341094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.342768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.395153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe51cf-e480-4e1e-b390-ad8cc70f59a4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.408694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.435312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.435972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.436323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.436599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.446359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 329/667] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:28.447170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.518597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.520051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.520177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.570480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552baf29-bf63-481d-bff3-9e32d90e5ef5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.609639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.610298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.610697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.610975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.611809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=6bee578760b649d7a8fc07d5e9770746) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.612122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.613697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.620777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 330/668] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/role_assignments?user.id=6bee578760b649d7a8fc07d5e9770746&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.629724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.634125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 339/669] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:28.635306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.652059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.765709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45475f-ee66-4de8-9d29-9f4cc5d94c2a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.767800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22e43-b7a9-4f26-8192-1af97656a20b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.799673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.809700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.810511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.810796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.811069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.813425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.814316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.814750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.815176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.816074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.816543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.818209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.822332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.823783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.828571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 331/670] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.829679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:28.844625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.845761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 340/671] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.852088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.937164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.962302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1a947-e723-4381-8bd7-365195b350b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.992153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d63a-4d8b-419c-ba9e-488194220dc4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.001966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.003389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.003909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.004395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.018255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.020327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.035862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.036817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.037193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.037592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:29.042795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.043822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.044777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:29.044777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:29.044777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:29.044777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:29.052229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 332/672] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.054124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.055316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.056941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:29.080288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.081258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.082354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:29.082354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:29.082354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:29.082354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:29.082354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 341/673] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.083220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.107442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.189324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cc0f-4c08-4881-ac63-eb5e27fcd390 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.213132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293065aa-bb63-4854-8d1a-e08bae1a096c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.233244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.234357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.235655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.236150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.236639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.237591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.238499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.240369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.255564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.260180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.260733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 333/674] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.262013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.277592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 342/675] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.277592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.383383 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.387890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a8b4-db6d-47d8-8f04-dc4b274966e2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.397535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962978-1842-498b-9c41-7937d76036ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.425579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.426621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.427002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.427407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.429575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.429995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.432145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.437039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.438051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.438488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.438931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.447145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 334/676] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.447590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.448190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.449625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:29.465747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.466853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.467912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:29.473560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 343/677] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.474529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.515368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.577665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426860a-d4bf-4482-bed2-83ce8b8ce8a6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.592234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa27c-6bd6-4b35-bd38-f9dc31fb525a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.613770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.614980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.615271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.615553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.624745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.626426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.628746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.629566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.629854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.630134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.637176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.638662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:29.642047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.643126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.644216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:29.645052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 335/678] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.645905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-be55417e-146a-4205-8cf8-20dcbebe35a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:29.655015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.656176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:29.657542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 344/679] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.658284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8f61-07ea-4a3c-8122-accce0c94618 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.658284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8f61-07ea-4a3c-8122-accce0c94618 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.658440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d8f61-07ea-4a3c-8122-accce0c94618 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.661415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 345/680] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:29.661415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d8f61-07ea-4a3c-8122-accce0c94618 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.674893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.761116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a744f-35c5-4405-b312-1b82a297555c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.767457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.777031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d8f61-07ea-4a3c-8122-accce0c94618 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.797824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.798481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.798763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.799040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.799825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.800139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.801575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.813733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 336/681] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.814519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.820162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.821202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.822447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.822885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.823846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.824312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.825947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec22f5-5af8-4483-8682-0bcc399de9f2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.845234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 346/682] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.845234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.845234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.845234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.861137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:29.862355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:29.908202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.941430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 347/683] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:29.941430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.950179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc0bb8-a0b3-45ba-96d4-205c32c1c643 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.987559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.988498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.988785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.989062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.990190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.991470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.993191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.014063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 337/684] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.015101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.033639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.049487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b833-ccd4-4d6a-8211-2c0b95215eeb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.085075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.085762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.086035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.086312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.087133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=819e7ece10414befa043f4b84da6c1f9) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.087438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.088873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.094810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 348/685] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/role_assignments?user.id=819e7ece10414befa043f4b84da6c1f9&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.095638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.147226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807fe2-54c7-4c96-85c3-3027665ab29f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.188610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.189665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.190562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.191028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.192067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=de74d94d77fd4220a976184b587f389e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.192557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.194576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.198592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.202929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 338/686] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/role_assignments?user.id=de74d94d77fd4220a976184b587f389e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.204411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.255576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1065-03a9-444d-9d3f-a6020c263616 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.298296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.298671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.298950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.299219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.316842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:30.326517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.327521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:30.329319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 349/687] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:30.337051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.349129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb950-449a-4ff7-9db7-7c98a33718c2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.352347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.401155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.402519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.403547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.404058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.470913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad818-20f6-4ed8-9f07-37499cb76120 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.494247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.497430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.499583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.521608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.523353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.523638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.523968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.525161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.525508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.527002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.538582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 350/688] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:30.547933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.636767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.664042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 339/689] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:30.666352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.704189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224bd1-7cea-4162-ac80-23ac28630879 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.768642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.770809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.771900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.772739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.788379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.788379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:30.808489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.809515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.810400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:30.810400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:30.810400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.810400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:30.813541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 351/690] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:30.815179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.859678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.863210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bd2a3-582c-4be3-a83f-c6f2fe638653 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.921873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.922578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.922856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.923134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.934403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.935879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:30.954121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.955053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.956423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:30.956423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:30.956423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.956423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:30.956423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 340/691] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:30.962475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.970979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9161-a69d-40af-816c-a9b8afec255b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.009269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.023208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.023871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.024153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.024427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.025627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.025938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.027672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2178992-194e-433b-9328-ec1a5adcb4ac None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.043936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 352/692] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:31.046515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ccc2-b950-4130-8f59-83fae9bb2671 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.047057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ccc2-b950-4130-8f59-83fae9bb2671 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.047527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ccc2-b950-4130-8f59-83fae9bb2671 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.050598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 353/693] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:31.052396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ccc2-b950-4130-8f59-83fae9bb2671 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.098631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b9f74-6bdc-4e83-a97f-3abe93ec7cee None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.137805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.138851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.139860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.140436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.141425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.141949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.143693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7b03-9c7f-43e3-9da7-fbd6f79b2ea8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.162534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 341/694] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:31.164752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.165315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.165836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.182720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ccc2-b950-4130-8f59-83fae9bb2671 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.185505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:31.186894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:31.195402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.225598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.226382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.226661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.226987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.240285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.242508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:31.260868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.261815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:31.262737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:31.265520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 354/695] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.267791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 342/696] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:31.268148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.269643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.342984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.389036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8646e-7699-40dd-94c9-11022e62a7d8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.410849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aee7f-4211-4203-bf1f-ee9bab0596a0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.431924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.432603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.432939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.433163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.434334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.434648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.436077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.452093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.453164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.453802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.454959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.455612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.461510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 343/697] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:31.462643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.471031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.473103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:31.488378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.489294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:31.490592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:31.498073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 355/698] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.499250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.590874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d8247-9aa3-4526-9b78-8a68552aea3e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.615291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8fc5-10fe-44b5-a1aa-e7911c71c344 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.618973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.637571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.638365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.638644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.638916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.652626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.654108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.656758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.657723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.658201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.658745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:31.675317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.676226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.677123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:31.677123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:31.677123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.677123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:31.681452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 344/699] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.682665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.743152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.746042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.748214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.796380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac28f-f31b-4258-ac20-dbd18cf7cee7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.833319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.834324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.834973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.835534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.836512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.837110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.838798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.857278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 345/700] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:31.858507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.865605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 356/701] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:31.867045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.872846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.978925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff9ab6-9f0f-4eb8-a148-2cdbb5b17f76 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.985941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f309-ac4c-4aee-88a5-666a0dcd37a4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.001533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.024419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.025087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.025368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.025690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.026709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=573c370fec404be39c9a21fbafd43a4e) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.027022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.028552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.029003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.029919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.030500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.030968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.031975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.032500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.034149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.041135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 357/702] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/role_assignments?user.id=573c370fec404be39c9a21fbafd43a4e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.041135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.060113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 346/703] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.067165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.123902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.199032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612da0e-3bf0-4e82-85cd-5025fcd203f3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.257155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3e86-75a4-4f8b-b68f-9ad353d46476 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.283204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.284524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.285086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.285577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.299520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.300651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.301148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.301667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.302700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.304451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.304570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.305942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.330506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 347/704] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:32 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-02cbd6a2-cec5-4268-b882-1455d0c55e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:32.332208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.333115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.334082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:32.334082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:32.334082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.334082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:32.338015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 358/705] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.343384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.379151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.469106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6ac5-dca1-461a-be46-e41445c2288c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.502428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf5fc-3d9a-4255-9b4b-07bd60af3718 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.503004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf5fc-3d9a-4255-9b4b-07bd60af3718 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.503004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf5fc-3d9a-4255-9b4b-07bd60af3718 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.504571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 359/706] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:32.510506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.511484 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.511610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e03f4-4003-47c5-89b6-ee49a805abe9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.511813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e03f4-4003-47c5-89b6-ee49a805abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.512093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e03f4-4003-47c5-89b6-ee49a805abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.512464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.512947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.513921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.514512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.516179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.531553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-595e03f4-4003-47c5-89b6-ee49a805abe9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:32.532771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-595e03f4-4003-47c5-89b6-ee49a805abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:32.534229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.540068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.624213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 360/708] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:32.625973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8deb9b-d09c-4778-b69f-0739fbab65f4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.626478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8deb9b-d09c-4778-b69f-0739fbab65f4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.626978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8deb9b-d09c-4778-b69f-0739fbab65f4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.628694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 361/709] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:32.634441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.635062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.635544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.655752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.657320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:32.658615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:32.672449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0faf9-37c4-4efa-b3ab-a8b37b24c6a3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.708958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.710375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.710749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.711040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.718439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.718581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.719921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:32.738410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.739365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:32.740268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:32.740717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 349/710] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.745409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.751092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 362/711] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 20 05:58:32.752163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.887945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98b077-ac42-4966-96b0-d648d2b9ea46 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.907133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ede2cd-2993-4de3-a14d-1c9fcb36cf1e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.932164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.933825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.934295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.935038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.936317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.937240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.939466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.945088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.945999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.946341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.946683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.947403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.948957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.954950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 363/712] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.955993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.966986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.968035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:32.968940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:32.977571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 350/713] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.977571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.993930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.013472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.078677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379879-c05b-4f44-b6b2-6220065f7620 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.097907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79811be-8b61-45cd-a953-236566ec4cf1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.114639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.115438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.115724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.116661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] PATH_INFO: `/v3/services/network` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.117451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.118943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.134000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.135020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:33.135843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:33.139993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.140231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 364/714] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.141095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.141204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.141716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.142192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.143227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.143865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.145639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.152684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 351/715] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.153895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.243315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.261098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335802e-485f-4c63-b4ed-735c65e07311 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.271160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.299936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.300615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.300901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.301181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.301945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.302254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.303999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.304512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39432a47-4703-4d7b-ac3f-c12202799060 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.309682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 365/716] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.321339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.379222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.379894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.380175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.380454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.381174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.382178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.388332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.398757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 352/717] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.405446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.476187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601d53-faa8-4b38-ba7b-2ad1146d6552 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.516770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.519027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.524353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.524862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.525829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.526347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.527932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad95d-b164-4aea-b522-f07049a7b65d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.540060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 366/718] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.579233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe23b-7061-4729-9941-bc55268c3f64 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.636572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.637282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.637927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.638207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.638964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.639273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.640703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51432594-6276-45b0-9809-8b1a9a0abd07 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.651806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 353/719] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.927907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ead4-9042-45b6-8fc4-d4e7936ae11a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.929188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ead4-9042-45b6-8fc4-d4e7936ae11a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.929698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ead4-9042-45b6-8fc4-d4e7936ae11a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.931529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 367/720] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:34.937264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.938142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.938802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.940054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b5ec-c583-4289-ae55-51b7ab25ac22 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.940345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b5ec-c583-4289-ae55-51b7ab25ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.940624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b5ec-c583-4289-ae55-51b7ab25ac22 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.942204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 368/721] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:34.947103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.947393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.947679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.949289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.968499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:34.970110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:34.976670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:34.978309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:35.032025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.107270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 354/722] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:35.108627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 369/723] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:35.132972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.152571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.293314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343b87e-3484-4779-a212-4a98526322f3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.344781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.345619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.345903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.346182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.348091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.360491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:35.368924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.369864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:35.370700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:35.371322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 355/724] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:35.376623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.389627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed4d2-4ea6-4095-89eb-e52a74771848 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.452181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.452982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.453256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.453551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.472630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:35.481126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.482072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:35.482973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:35.490838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 370/725] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:35.496926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.532103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.560211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148152-9c5d-4344-aab2-f4d42037fbdd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.597682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.598585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.599010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.599426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.600387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.600838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.602377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92108a85-c635-4d14-af8f-cec91eb19adf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.625974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 356/726] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:35.628185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047ac7-52cc-4753-b6e0-b3f31c1fd951 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.628603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047ac7-52cc-4753-b6e0-b3f31c1fd951 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.628992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047ac7-52cc-4753-b6e0-b3f31c1fd951 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.630796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 357/727] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:35.632067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047ac7-52cc-4753-b6e0-b3f31c1fd951 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.660703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a10b4-5895-43d2-9db0-2911a911e554 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.695514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.696180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.696459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.696734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.697502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.697693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.697795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.699168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1dd0-e1d9-4afb-a3db-cda2c7250076 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.713078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 371/728] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:35.714488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.714780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.715060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.732224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:35.733429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:35.748849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047ac7-52cc-4753-b6e0-b3f31c1fd951 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.788426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.789348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.789669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.789945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.803324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.804500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 372/729] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:35.804788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.805442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.824273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:35.845644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.846613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.847476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:35.847476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:35.847476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.847476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:35.847476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 358/730] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:35.848374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.930454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb248dd-0048-4897-ae6e-c820138e1578 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.950230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2666b6-a105-442e-8d18-9a171d2d552b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.961566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.968180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.968972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.969248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.969547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.980772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.982252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.989372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.990463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.990786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.991067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:35.999482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.000334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.001221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:36.001221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:36.001221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:36.001221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:36.002591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:36.005353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 373/731] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.006203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d459fb80-9da2-4c6a-916c-dbc82a751d57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:36.011252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.012166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:36.013022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:36.017592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 359/732] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.018960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39a5d-0d13-414c-8d3b-071b56dbba23 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.019143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39a5d-0d13-414c-8d3b-071b56dbba23 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.019294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39a5d-0d13-414c-8d3b-071b56dbba23 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.021423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 360/733] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:36.021703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39a5d-0d13-414c-8d3b-071b56dbba23 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.079802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.121583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f12381-b233-4632-89c6-4a62d74fc7a8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.150873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39a5d-0d13-414c-8d3b-071b56dbba23 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.159989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.160652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.161149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.161274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.161940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.162498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.163704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.179886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 374/734] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.179886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.193645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.194839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.195122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.195403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.196133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.196447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.197853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57da5-ea3b-4924-b6a3-ca1148d19838 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.209326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 361/735] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.211307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.211600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.211881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.228817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:36.230044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:36.255989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.290069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c14b-a0f0-4b94-9ea1-596e79fab796 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.303016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 362/736] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:36.304052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.315695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.325012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.326036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.326561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.327039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.328005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.328515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.330202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.339477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 375/737] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.340123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.415626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5e204-13e8-4e65-b4bb-6a03e98646bf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.438572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084da73-5290-43ad-be20-1b9b8f080f49 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.449655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.450460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.450741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.451017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.458426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.460307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.474109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.474895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.475192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.475465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-226cc967-99bf-4f3f-b7f8-91e3fc46a514 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:36.475906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.476973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:36.478140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 363/738] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.478845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405c05-f8e5-4151-92f9-2e3ad1419338 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.479131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405c05-f8e5-4151-92f9-2e3ad1419338 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.479403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405c05-f8e5-4151-92f9-2e3ad1419338 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.480802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 364/739] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:36.485219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405c05-f8e5-4151-92f9-2e3ad1419338 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.486441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.487903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:36.502490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.503661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 376/740] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.504873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.511883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.552591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.594715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405c05-f8e5-4151-92f9-2e3ad1419338 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.603586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478eef5-79e8-4e8d-a937-0c2cdb2e013a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.628264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.628924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.629210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.629523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.630248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.632224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.636959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.637779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.638107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.638387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.657415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 365/741] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:36 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:36.657415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.657709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.657709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f994250f-533c-44bf-bef5-5a271476f538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:36.672339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.673365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.674317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:36.674317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:36.674317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:36.674317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:36.674317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 377/742] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.675374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.675374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.675553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.696521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:36.697506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:36.757664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.791252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 378/743] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:36.792576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.804183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd3027-899e-4d11-8a8b-cc9a68f42654 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.831370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.847308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.848275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.848275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.848443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.849282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.849627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.851598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.870973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 366/744] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.870973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.921435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1498a9-5f79-40c2-a118-854a974c5a0b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.956853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.957537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.957814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.958086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.958914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.959220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.960799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.977172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d94be-9c2b-41ac-9874-05afb9762a25 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.979730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 379/745] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.980520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.011506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.018431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.019097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.019379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.019657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.020886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.021196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.023523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.036879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 367/746] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:37.038578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.067839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.086845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c645f30-1f4a-43bd-b3c4-5bff52d60e05 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.124227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.124801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.125080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.125352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.126097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.127465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.146800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 380/747] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:36 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:37.148934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.165618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79e3b-dde2-4ed6-b625-d357da70ad4f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.220150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.221310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.222076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.223005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.274091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8ffa-3c4c-442d-a5e2-8a88b2b92360 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.309598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.321703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.322580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.322863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.323138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.326650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.328634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.343450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.418404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.420815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.464101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 368/748] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:37.465039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.537040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 381/749] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:37.538480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.576741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.591374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4e87d-fc43-4f25-ad9d-4ba3fe01a3a4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.600176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.630346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.631130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.631927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.632607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.639845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.641329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:37.656446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.657445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:37.658373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:37.662237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 369/750] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.663963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.676485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cbb6-6c0b-41e3-ba50-1c649484eac3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.724524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.726784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.727248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.727938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.743199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.744918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:37.768793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.769829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.770732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:37.770732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:37.770732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.770732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:37.773464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 382/751] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.774531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.779474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142632-95e8-4751-96ba-37c49fc138a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.816226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.816977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.817313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.817616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.829320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.830876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.853810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:37.856564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.857465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.858359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:37.858359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:37.858359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.858359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:37.858359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 370/752] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.859119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.891742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.900799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20aa74-a423-4e51-a5fa-74ffcc5721d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.936689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.937711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.938193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.938663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.939707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.940221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.941899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.962342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 383/753] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:37.963903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.998656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075f6a-14ee-4ba3-8217-ef8df48f9973 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.048152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.048993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.049496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.049659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.050451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.050761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.052416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.075906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 371/754] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.077192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.080156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceec974-72ec-4775-9601-f6448d2e80fb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.117533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.118509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.118997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.119537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.120602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.121125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.122720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.135187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 384/755] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.136337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.143842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.154766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.191941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c30e1-8e22-4c1a-be80-375cb80a49bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.229068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.229904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.230183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.230456 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.242124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.243695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.245998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e0f6-6fcb-428e-a5fc-5a23f2235f20 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:38.262688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.264571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:38.264571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:38.264571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:38.264571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:38.268451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 372/756] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.269368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.284433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.285624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.286193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.286666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.294686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.296442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:38.317082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.318043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.319745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:38.329492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 385/757] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.330717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.421978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.450923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4880ce-2e53-481e-9b3a-09d380c34348 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.488977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.489818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.490194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.490817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.491407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.491808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.493409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.508342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789089e7-89e4-4fef-af91-0e37a327e3b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.510413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 386/758] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.511463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.525845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.555203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.556021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.556295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.556562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.565735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.567449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:38.586158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.587071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 373/759] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.588567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.632828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad163a-4d57-4184-82bc-336b7eb25385 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.678715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.679796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.680276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.681197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.682213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.683336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.685792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.688384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.705833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 387/760] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.706777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09daccf-aa2e-47e5-9bfb-7d3c7c3ed2b4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.707139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.747689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.748498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.748780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.749051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.755940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.757615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:38.771517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.773624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.774739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:38.777515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.778545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.811163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.829955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57bbf-0716-42a3-b235-b2fe8ebea32d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.868036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.868696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.869006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.869309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.870114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.870424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.871879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5377b41-b3c2-49c4-a177-6d7d690eacd4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.886073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 388/762] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.888072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd499c09-61a8-4fb6-8af6-1e61447c5241 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.888600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd499c09-61a8-4fb6-8af6-1e61447c5241 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.889006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd499c09-61a8-4fb6-8af6-1e61447c5241 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.890490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 389/763] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:38.890982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd499c09-61a8-4fb6-8af6-1e61447c5241 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.898267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03d20e-5b60-4011-8dc0-556a8cba06bf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.935181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.935982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.936273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.936615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.937542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=486089870c21413b8618845b3217da76) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.938044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.939324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.953413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 375/764] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/role_assignments?user.id=486089870c21413b8618845b3217da76&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.953413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.963471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.017151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd499c09-61a8-4fb6-8af6-1e61447c5241 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.060346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.061128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.061501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.061845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.062706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.063102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.064700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2fa3-3374-454c-9441-98258303da57 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.079260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 390/765] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.080748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.081101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.081472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.083018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.098362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365887-f3ae-4029-81ad-7849bba4eb98 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.100693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:39.102149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:39.149997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.150706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.150983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.151257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.152141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=573c370fec404be39c9a21fbafd43a4e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.152454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.154019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.160325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 376/766] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/role_assignments?user.id=573c370fec404be39c9a21fbafd43a4e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.160959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.197542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 391/767] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:39.216413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.268159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.299311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69855b9-c092-4b2b-ac3a-77470c829599 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.345787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c4db2-d7cf-444c-8e0a-7174f0f10c4f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.353972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.355261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.356480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.356987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.360443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=115ba46eabce4863a597ad69bca1703c, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.362764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cda62-4523-4bf2-a1ca-2022b773dbae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.383827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 377/768] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:39 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:39.386033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6eed-a788-4322-b923-202d8568b927 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.386527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6eed-a788-4322-b923-202d8568b927 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.387018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6eed-a788-4322-b923-202d8568b927 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.389091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 378/769] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:39.397487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.397487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.397487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.410914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.411746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.412027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.412301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.413042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.414528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.417656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:39.419144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:39.437786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:39.451815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:39.453006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:39.454053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 392/770] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:39.461909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.505467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 379/771] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:39.562478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.640286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a936-8f47-4f61-a81c-4164660708b9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.652558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.690296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.691235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.691520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.691798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.692474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf7047-4133-412a-9ce6-04fdcdc2c454 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.692611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.692806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.694325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.701044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 393/772] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.706279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.758224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.759405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.759901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.760414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.761280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.762896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:39.779257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:39.780279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.781110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:39.784064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 380/773] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:39.789861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.810649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.849081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978327a-21dd-4e28-9e7d-6dd5d526dff7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.905420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbea80-32ae-4bcf-a5ea-e9fe2686bc54 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.914173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.914850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.915132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.915409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.916115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.916480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.917996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.929436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 394/774] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:39.935204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.946843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.947893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.948409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.948893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.949887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.950546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.952166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.957912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 381/775] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.966403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.019410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.073749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.085673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67844ab-329d-4cd4-b227-3566db4d4856 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.127085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3fc22-c1a1-43c3-ba7e-df385a6aff41 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.162194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.163001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.163404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.163659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.163880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.163987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.164258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.164366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.165014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.165323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.165446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] RBAC: Adding query filter params (interface=public, service_id=ec214523cca04909a945281cc1c1f4d2, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.165847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.166704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.167412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.175605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 395/776] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/endpoints?service_id=ec214523cca04909a945281cc1c1f4d2&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.177451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 382/777] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.182377 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.185015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.286864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea31b7a-c8f2-4851-baea-cd4f826df604 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.288717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.323263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.324026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.324384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.324740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.325530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.326993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.332819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 396/778] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.351712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840e22-a203-43bd-aa4b-728f6d697e2e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.406122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.406798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.407086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.407366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.408173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] RBAC: Adding query filter params (interface=public, service_id=adbb21ec8a364049a489ad496e9ea7b6, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.408489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.409898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325afd44-5299-47d6-afa9-8e74d9c1af99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.424563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 383/779] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/endpoints?service_id=adbb21ec8a364049a489ad496e9ea7b6&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:40.430756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.551000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb7c2e-72a4-4aea-8cb5-9cd29f6b1a5a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.587585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.588261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.588547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.588826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.589552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.590966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ff49-018f-4a80-971a-95132135ec91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.597211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 397/780] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:41.618290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823509-7d84-43cb-9f8c-2ed20b281c10 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.618786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823509-7d84-43cb-9f8c-2ed20b281c10 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.619161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823509-7d84-43cb-9f8c-2ed20b281c10 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.620846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 384/781] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:41.627394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694cc9-6fea-429d-84e5-7786fdffbffe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.627846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694cc9-6fea-429d-84e5-7786fdffbffe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.628027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694cc9-6fea-429d-84e5-7786fdffbffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.658475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c5694cc9-6fea-429d-84e5-7786fdffbffe None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:41.659685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c5694cc9-6fea-429d-84e5-7786fdffbffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:41.688973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:41.756050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 398/782] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:41.791081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5823509-7d84-43cb-9f8c-2ed20b281c10 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:41.795506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fccf9-95c5-4e5e-bfdd-b3378ec20044 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.795801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fccf9-95c5-4e5e-bfdd-b3378ec20044 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.796088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fccf9-95c5-4e5e-bfdd-b3378ec20044 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.797537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 399/783] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:41.802686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72703c-4924-49f9-b2e9-c9904f4e3895 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.802901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:41.803600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72703c-4924-49f9-b2e9-c9904f4e3895 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.803803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72703c-4924-49f9-b2e9-c9904f4e3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.836959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3a72703c-4924-49f9-b2e9-c9904f4e3895 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:41.838207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3a72703c-4924-49f9-b2e9-c9904f4e3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:41.929615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 400/784] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:41.930957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ebbf-9750-45b2-b7cc-777e329466ba None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.931239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ebbf-9750-45b2-b7cc-777e329466ba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.931515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ebbf-9750-45b2-b7cc-777e329466ba None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.933001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 401/785] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:41.938206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.938486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.938764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.968960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:41.970228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:41.978403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5823509-7d84-43cb-9f8c-2ed20b281c10 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.030452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.031814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.032096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.032369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.046471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:42.061568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.062564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 385/787] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.063386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.064717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 402/787] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:42.067520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.088664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.180375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ae52-1620-4722-b362-ce84b0cc9b3e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.189759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.191342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b65da-f1cf-4350-a56b-949512e2e644 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.215394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.216206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.216446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.216715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.228105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:42.231437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.232339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.232872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.233414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.234406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.234928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:42.235774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.236684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:42.237590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:42.239556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.242434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 386/788] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.243172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.251031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 403/789] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:42.252147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.346799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.367219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4c37-0f8c-4067-bdc6-5f9a258ed70b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.369229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb49b8-8ddb-474b-9230-3c2896ecfa01 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.402616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.404118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.404852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.405208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.405581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.406381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.406751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.408174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.409954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.411158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.411678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.412165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.421738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 404/790] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:42.422682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.425477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:42.435652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.436603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.437465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:42.440374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 387/791] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.441450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.539807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11591b5-3b1d-44a9-86ae-6ed368b227ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.559247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d093b6-0b3b-4bd4-8761-e056de94ea9d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.574874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.575670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.576011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.576289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.588047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.589688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.591637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.602466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.603674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.604156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.604628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:42.608862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.609753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.610636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:42.610636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:42.610636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.610636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:42.611375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 405/792] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.615128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.618286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.620012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:42.642361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.643285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.644159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:42.644159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:42.644159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.644159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:42.646568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 388/793] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.648562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.704880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.749308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c0a4-ddac-4597-9519-e5bf332da0c1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.786573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.787016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff093ab-3339-40ec-892e-c50d2e5842f3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.789043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.789640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.790161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.791108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.791607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.793196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.804032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 406/794] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:42.805462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.828688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.829364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.829689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.829968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.830908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.831017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.832324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.844872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 389/795] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:42.845844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.875867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.927086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4b80-789b-4a02-ba7f-7dada516148c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.949863 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.954413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f360478-9eeb-4b5d-a1d1-ffafe62dc6bd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.965995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.966887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.967171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.967587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.968302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.968611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.970013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.982348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 407/796] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:42.983010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.996219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.997006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.997279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.997599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.011592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.013056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ba1fae6d-99c8-400e-b65f-68d92a16c670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:43.031269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.032156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.033028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:43.033028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:43.033028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.033028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:43.033028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 390/797] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.033986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb84-26fd-490e-95b7-dd48a04b2e75 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.033986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb84-26fd-490e-95b7-dd48a04b2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.034262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb84-26fd-490e-95b7-dd48a04b2e75 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.035659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 391/798] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:43.040650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5bb84-26fd-490e-95b7-dd48a04b2e75 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.098619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a933-e65d-428d-b8ac-d3bc57afcf42 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.116633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.134697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.135485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.135766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.136037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.143119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.144559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.146686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5bb84-26fd-490e-95b7-dd48a04b2e75 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:43.160004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.160931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 408/799] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.162489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.183921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.184721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.184996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.185268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.192277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.193815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-07cb4006-f0db-4001-a91f-f208df39f35f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:43.208491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.210340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:43.211302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 392/800] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.211891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df683-4924-4322-8986-3767fbf19883 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.212482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df683-4924-4322-8986-3767fbf19883 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.212482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df683-4924-4322-8986-3767fbf19883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.228565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-065df683-4924-4322-8986-3767fbf19883 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:43.229698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-065df683-4924-4322-8986-3767fbf19883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:43.232341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.269153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9f19-f8dc-4c8e-a1bc-a15e9e3d5fb9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.297862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 393/801] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:43.299160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1161c3-7a81-4870-9548-1461763558a6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.299450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1161c3-7a81-4870-9548-1461763558a6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.299732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1161c3-7a81-4870-9548-1461763558a6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.300978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 394/802] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:43.301687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1161c3-7a81-4870-9548-1461763558a6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.311352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.312096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.312443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.312787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.313605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.313975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.315434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.327282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 409/803] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.328094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.364620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.422941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1161c3-7a81-4870-9548-1461763558a6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.430024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a54c-98d7-4901-acf3-ef794f3ea8c7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.457825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.458490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.458768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.459043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.460602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.460912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.462367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b2c7-cb8c-4e0b-b989-1e3947e18584 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.464025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.465332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.465332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.465332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.466057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.466364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.467799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.470878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.480557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 395/804] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.481609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.481896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.482176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.489355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 410/805] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.490194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.501183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:43.502710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:43.570175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 396/806] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:43.571010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.594984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.602899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f377cc-fba0-4ca0-95e2-0dd1711e6192 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.639126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.639927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.640210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.640489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.641131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.642550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.655433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.656588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.657578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 411/807] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.658490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.673925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139d57-b44b-42ea-8c2f-d19cdbfdfb1e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.699905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.708506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.709332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.710192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.710473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.717497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.718930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:43.733926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.734854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 397/808] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.735816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.763576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561cd0-764c-4385-83d6-1aa297f089b2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.796972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.797784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.798073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.798348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.809126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.810604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:43.827901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.828842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 412/809] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.830146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.843127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638163a9-7a86-4763-9a0b-0c8a36a1d434 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.843289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.876893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.877710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.877984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.878256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.889259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.890746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:43.907916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.908983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.909915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:43.909915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:43.909915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.909915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:43.909915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 398/810] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.910474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.931144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5508bd-d8de-4356-9bd3-777bd9c0ff7c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.952933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.965137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.965958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.966254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.966534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.967184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.968569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.980232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.981299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:43.982160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 413/811] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.982939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.012604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b57ed9-ad7b-4fbb-838c-03e2562146c9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.046824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.047480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.047764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.048039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.048753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.049060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.050475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.055140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 399/812] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.055918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.058829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.085708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b26c6-83ff-4b3f-a0a9-0a81b2fabfe8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.122859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.123525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.123810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.124086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.124918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.125232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.126716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.144270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 414/813] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.145061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.160732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-43b1-44da-9c3a-8ce3dfdd4aef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.163615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.196381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.197030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.197307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.197608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.198319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.198618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.199969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.211974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 400/814] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.212745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.245433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed034-828b-4c25-9c70-ee19aabab4a2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.276480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.281528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.282188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.282479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.282759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.283473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.283782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.285174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.296670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 415/815] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.297486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.319607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04af44-8bdc-4b9f-b32d-3827c3869be7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.354102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.354761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.355047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.355324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.356026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.356331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.357731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.362208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 401/816] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.362976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.391445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.406676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68e4-8bbe-40a7-bcbb-116ff755fc85 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.440171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.440826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.441116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.441412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.442113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.442421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.444860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.451333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 416/817] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.451333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.467451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cd23-225f-4987-8309-3d54a3d39c37 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.500967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.501647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.501930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.502207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.505574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.549731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee236fa1-6acd-4a76-83c6-1afc325ce019 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.570572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.572025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.582688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.583536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.583820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.584092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.590730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.592162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.598020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:44.607623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.608574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:44.609491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 417/818] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.610549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.669877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 402/819] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:44.670716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.716076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76084-2c88-40ae-a1f7-482556f42d36 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.731846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.749878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.750652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.750931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.751202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.758090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.759529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.767091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e7132-f883-4c23-8fdc-5af7d44bbca1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:44.773681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.774802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 418/820] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.775693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.796289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.805593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.806190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.806467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.806739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.807440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.807740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.809122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.813816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 403/821] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.814574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.875800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85aa2-9b80-4d80-979f-5671d2db341d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.908455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.909097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.909407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.909677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.910405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.911774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.914586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea3c5b-82c9-4930-9998-210d65c5fcae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.932601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 419/822] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:44.933422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.957412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.958089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.958364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.958642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.960000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.960304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.961870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.970740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.982613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 404/823] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.982613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.039038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.052749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f697-6de1-4fff-b687-ab20fe27b27b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.102028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311e23-6edd-47d4-bd1b-33088f233f78 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.103128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.104189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.105452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.105805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.124908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.129315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.152971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:45.153639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:45.154475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:45.155348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:45.155348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:45.155348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:45.155348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:45.156020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.156020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.156020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.156423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 420/824] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:45.156423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.156560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.156868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.158360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.171378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 405/825] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.172048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.253192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.274370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d48b7-53d9-4769-9b89-7d8532589daa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.282268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839be6d-61b0-4ca5-8eda-c4022ac07ead None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.291191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.317893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.320005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.320480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.320966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.321072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.321931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.322223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.322350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.322503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/573c370fec404be39c9a21fbafd43a4e/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.324055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.324510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=573c370fec404be39c9a21fbafd43a4e, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.325965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.340926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 406/826] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:45 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/573c370fec404be39c9a21fbafd43a4e/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:45.350834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.357514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 421/827] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:45.357514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.566341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee4203-e50d-479a-bb4c-dc8d3fc9685f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.573871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e521db-5c0c-4326-a2b3-d41a2852af3f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.612527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.613781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.614345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.614862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/486089870c21413b8618845b3217da76/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.616473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.617104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.617402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.617691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.618426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.618739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.620246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.621435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.635538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 407/828] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.636025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=486089870c21413b8618845b3217da76, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.638536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.642347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.669671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 422/829] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:45 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/486089870c21413b8618845b3217da76/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:45.700224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.802584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ddfc4-4c21-4d03-be82-e233150d064f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.845418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.846242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.846522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.846799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.856493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.858010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:45.875691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:45.876621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:45.877629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 408/830] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:45.883375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.997203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2918f-18a0-45d7-b418-5cbaed13161c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.035752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.036515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.036892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.037242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.038863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:46.041465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.041465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae713a-4037-4566-b072-49189c026dd0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.054477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 423/831] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:46.070302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.255637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.281406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea6c6-7b58-4f3e-958c-9fbd90bf8401 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.318168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.318904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.319192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.319471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.320316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:46.320630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.322105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76344c-c113-4293-b6a1-726a48636873 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.331828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 409/832] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.280829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd48c-7dfa-438c-94b2-be0e262aefd1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.281496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd48c-7dfa-438c-94b2-be0e262aefd1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.281788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd48c-7dfa-438c-94b2-be0e262aefd1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.283532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 424/833] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:47.290452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.291114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.291114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.311142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:47.312369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:47.392802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 410/834] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:47.420462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd48c-7dfa-438c-94b2-be0e262aefd1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.489830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.548165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd48c-7dfa-438c-94b2-be0e262aefd1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.592337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.593155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.593470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.593820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.595043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.596589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-23fae8a8-11ac-4b4e-905b-703c42783e18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:47.614001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:47.615071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:47.616821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 425/835] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:47.623147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.701717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a69ed-08d4-49ea-9434-1e9321f11dee None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.702189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a69ed-08d4-49ea-9434-1e9321f11dee None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.702297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a69ed-08d4-49ea-9434-1e9321f11dee None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.707989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 426/836] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:47.709921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.710293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.710569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.716974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.730265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:47.732204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:47.736627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83528d-ccf7-4939-aba8-bf1f06c517dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.775312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.776129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.776505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.776878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.777822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.778341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.779831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.785240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 411/837] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.791822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.823044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 427/838] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:47.846582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.902990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.905444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3d455-ada8-48bf-859c-c363e4456af7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.943004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.943956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.944379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.944819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.945707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.946246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.947749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.961539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 412/839] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.976418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfec7-50eb-4f36-8bc8-d7fff1dea708 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.021368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.022272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.022561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.022834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.035638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2e2284ab-5e04-4ede-b8a6-aa2cce11226c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:48.044140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.045108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:48.046242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 428/840] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:48.054203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.068233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.150027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099227e5-ff45-4cac-b3f2-454c4b0b25e1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.150348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099227e5-ff45-4cac-b3f2-454c4b0b25e1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.150651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099227e5-ff45-4cac-b3f2-454c4b0b25e1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.152149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 429/841] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:48.156911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.157200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.157872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.171621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8fd6-fa71-48b5-bf87-0948e4f97963 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.179064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:48.180343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:48.219904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.221241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.221555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.221896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.222597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:48.222912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.224413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.236047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 413/842] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:48.242886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.270418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 430/843] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:48.295267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.334232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.341580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.376605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5c2b7-9f67-40bb-8795-9f823bc4de41 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.413155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.413927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.414210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.414495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.426149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.427598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.428437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addcee9-8128-4ef2-9632-ac3c7fd33a3d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:48.446014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.447118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.448079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:48.448079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:48.448079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.448079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:48.451908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 414/844] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:48.452761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.472752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.474206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.474638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.475713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.489702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:48.498132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.499334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:48.500244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:48.504755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 431/845] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:48.508091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.585278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d7342-451d-4505-b45b-a69581fdfcf4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.609740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.616805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.620121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482af-92e9-4f0b-890f-0d31eaa13466 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.628737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.629422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.629944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.630122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.630818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:48.631370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.632656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d2b2-f90d-443d-9050-d9d8b6505bed None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.644938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 415/846] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:48.646245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa50b-1a84-404c-9803-44aa80fcc9a2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.646539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa50b-1a84-404c-9803-44aa80fcc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.647386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa50b-1a84-404c-9803-44aa80fcc9a2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.649085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 416/847] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:48.653632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa50b-1a84-404c-9803-44aa80fcc9a2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.663068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.664114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.664341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.664621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.665394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:48.665727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.667129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce048-5aca-459b-adfe-76608b8429d2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.675614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 432/848] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:48.677749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.678278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.678768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.695212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:48.696413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:48.769813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa50b-1a84-404c-9803-44aa80fcc9a2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.785402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 433/849] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:48.785402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.806121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.806910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.807196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.807471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.814906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.816352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:48.831489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:48.833413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:48.837479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 417/850] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:48.838314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.875161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.886687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.895791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fb13d-3de4-4ff2-b6fd-d23779ec8599 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.936416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.937132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.937417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.948149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b37f-4b90-46c8-802f-edad2fde08af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.948778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.950264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:48.969120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.970177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.971046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:48.971046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:48.971046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.971046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:48.971046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 434/851] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:48.971319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.989559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.990392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.990700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.990957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.991617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.992977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.005230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.006989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:49.007910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 418/852] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.008830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.123335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454520d-2bd4-48ca-84c6-d40fedd5e645 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.134212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.165090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.165800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.166080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.166353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.167075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.167379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.168743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.181255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 419/853] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.182093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.214121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc0bb-e7c8-4d34-8e67-30057f6d2833 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.256198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.257202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.257688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.258168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.259005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.259381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.260871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.262973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.285290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 435/854] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.285290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.299413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b28c5-29a2-44a9-979c-d6731302a33a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.336965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.337840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.338123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.338396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.339095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.339397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.340755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.350331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 420/855] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.350331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.379644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.403594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062f47e-9c05-47ad-ba97-d43daa3e5d92 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.439440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.440239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.440515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.440785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.448204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.449658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.452553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dea42-0223-404c-8ef3-1e05d9c53d9a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:49.467961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.468908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 436/856] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.470271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.496982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.497654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.497933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.498208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.527979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.574137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.575700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.581923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79697328-0fb5-4cf8-a78a-51af1d00f8c6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.609392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.617159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.617849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.618128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.618400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.619216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.619525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.620897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.637425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 437/857] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.637425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.712808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 421/858] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:49.713965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.750694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fab217-47b0-4684-93fe-b3d4be5bb575 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.781841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.797840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.798513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.798799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.799077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.799911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.800227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.801762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.828436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 438/859] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.834638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.847108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af546a-9d56-43bf-812b-35164e6e6242 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.878786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.884925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.885939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.886284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.886623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.898454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.900054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:49.919227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.920334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.921458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:49.921458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:49.921458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.921458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:49.922868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 422/860] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.928067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.960050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c0a0-3250-49c3-8b0f-a567fe9f4d3b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.997725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.998639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.999016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.999492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.047087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.061710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c29e-b4d7-4136-823c-d03f1c26536e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.087461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.089145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d9826-5844-4b3e-9d5e-a38053281d3a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.101146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.101838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.102115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.102385 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.103108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.103410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.104803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.122640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 423/861] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.123543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.174026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.197972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 439/862] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:58:50.203535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28d24-1ce4-4ade-ad0b-3c0e8ece709c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.203885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28d24-1ce4-4ade-ad0b-3c0e8ece709c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.204232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28d24-1ce4-4ade-ad0b-3c0e8ece709c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.210471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 440/863] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:50.210471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28d24-1ce4-4ade-ad0b-3c0e8ece709c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.237925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741926-e4a4-4073-a007-46bfeb38dc14 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.272782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.273866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.274156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.274435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.281145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.282619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.293228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-33ed5bfe-2e57-47bd-a170-cd817eac94f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:50.297283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.298330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 424/864] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.304479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.305087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.319000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:50.320228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:50.340788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28d24-1ce4-4ade-ad0b-3c0e8ece709c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.382427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.383042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.383319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.383601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.394051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.394769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 425/865] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:50.395814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.406274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:50.414679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.415901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.416800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:50.416800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:50.416800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:50.416800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:50.420520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 441/866] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.421841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.448478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.520490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502dc80-db9c-4076-88ec-3b79ee690928 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.526240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161ac22-3cec-4c0b-99b9-f9d16fa9e914 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.553655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.557941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.558709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.559088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.559477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.560435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.560837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.562418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.562721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.563378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.563662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.563943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.564665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.566070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.576166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 426/867] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.581958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.589522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 442/868] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:50 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:50.589522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.699806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.712368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b8c43-f121-4425-bc67-0257f9f6c1dd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.733417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed50f-e8c9-471d-9b31-00ad4b96f14c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.751516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.752400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.752686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.752961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.753726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.754038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.756470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.772209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 427/869] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.778600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.787279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.788117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.788490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.789346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.790337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=573c370fec404be39c9a21fbafd43a4e) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.790747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.793173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.800754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 443/870] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/role_assignments?user.id=573c370fec404be39c9a21fbafd43a4e&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.905134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ded29-443a-42d7-a139-b53604ced293 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.945048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.946163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.946617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.947035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.954898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.956533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:50.971573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.972657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.973752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:50.976340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 428/871] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.982197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.038557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.097498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17270-2bb5-455d-8643-39b2898a3210 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.131741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.132479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.132758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.133032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.133908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:51.134213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.135710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbefe5-f0dd-4a77-9486-e6cbc0780dd8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.149473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 444/872] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:51.155476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.173533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.262388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bcfa1-e0b5-4bd5-a3cf-fa266d52fab1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.297510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.298267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.298660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.299014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.299976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=486089870c21413b8618845b3217da76) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:51.300365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.301887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3555-acd3-4d0e-9477-531ee1a86bf5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.309076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 429/873] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/role_assignments?user.id=486089870c21413b8618845b3217da76&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:51.732667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a98a4-d7f1-4bef-9e83-c45e7f4c7d0d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.733192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a98a4-d7f1-4bef-9e83-c45e7f4c7d0d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.733192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a98a4-d7f1-4bef-9e83-c45e7f4c7d0d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.734867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 445/874] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:51.739963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539afa7-79d7-416b-ad95-b42112c286a5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.740958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539afa7-79d7-416b-ad95-b42112c286a5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.740958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539afa7-79d7-416b-ad95-b42112c286a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.759117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0539afa7-79d7-416b-ad95-b42112c286a5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:51.760290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0539afa7-79d7-416b-ad95-b42112c286a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:51.829606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 430/875] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:51.852583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a98a4-d7f1-4bef-9e83-c45e7f4c7d0d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.962665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a98a4-d7f1-4bef-9e83-c45e7f4c7d0d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.970390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.999314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.999897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.000176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.000451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.001164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.002570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e2c52-2710-4acb-83bd-99c76148a0a0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.018942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 446/876] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:51 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:52.807958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeec68-5965-4e40-bd97-8a438fef493e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.808502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeec68-5965-4e40-bd97-8a438fef493e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.808502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeec68-5965-4e40-bd97-8a438fef493e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.810179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 431/877] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:52.815331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f557-2145-4631-9035-8b4621a5b6ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.815721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f557-2145-4631-9035-8b4621a5b6ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.815888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f557-2145-4631-9035-8b4621a5b6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.833750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9ff9f557-2145-4631-9035-8b4621a5b6ff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:52.835096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9ff9f557-2145-4631-9035-8b4621a5b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:52.911903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 447/878] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:52.935268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeec68-5965-4e40-bd97-8a438fef493e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.946858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.027469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944967-7142-4a6f-ba40-85016c8c0dce None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.027797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944967-7142-4a6f-ba40-85016c8c0dce None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.028035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944967-7142-4a6f-ba40-85016c8c0dce None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.029677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 448/879] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:53.040079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.040490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.041043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.048541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeec68-5965-4e40-bd97-8a438fef493e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.061988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:53.063650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:53.085423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.086353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.086765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.087092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.087761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.089401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.106320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:53.112205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 432/880] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:53.113011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.165832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 449/881] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:53.186646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.191976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.217969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.229612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b19b-0517-41ca-9f0d-5b307ef64315 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.271010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.272365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.272635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.273441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.274319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.274691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.276234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.285827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 433/882] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:53.287690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.318257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270911f9-e4b4-474f-a09d-53d278bd1c85 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.362481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.363708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.363992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.364268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.364947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.366938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.382713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.383745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:53.384599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:53.389480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 450/883] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:53.394368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.429146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76ecd-451f-4a63-bad2-63cc3a0bd4d1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.465628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.466702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.467172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.467663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.468549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.469049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.470728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.472978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.485659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 434/884] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.486927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.497832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.517054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a5970-f360-4734-996a-c778d84c01bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.557052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.557759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.558055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.558330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.559025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.559336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.560717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d695e-92c9-428c-bc22-4dd9dfd03b59 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.565705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 451/885] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.566927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d97ad5-d258-4848-88f5-5200a304d95a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.567211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d97ad5-d258-4848-88f5-5200a304d95a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.567487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d97ad5-d258-4848-88f5-5200a304d95a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.572781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 452/886] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:53.573538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d97ad5-d258-4848-88f5-5200a304d95a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.596367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3293a-6dce-4992-b08a-76b987042be6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.632199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.632867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.633153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.633483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.634284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] RBAC: Adding query filter params (interface=public, service_id=4aead8ae979948e9b59baa821dcf97a0, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.634603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.635978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a1b1-010b-4777-ba2d-753d4d6a4226 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.641343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 435/887] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/endpoints?service_id=4aead8ae979948e9b59baa821dcf97a0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.642368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.642654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.642930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.660600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:53.661925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:53.690994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d97ad5-d258-4848-88f5-5200a304d95a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.725781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.730441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.731109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.731390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.731684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.732352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.732654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.734063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.735802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 436/888] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:53.736493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.749960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 453/889] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.761740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.781699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.883146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144faf9-b8f3-4771-8448-7db14d9a064b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.903203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc129f4c-e4a8-4956-80cc-63d2c6a5ad57 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.923570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.924440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.924716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.925032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.943222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:53.950331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.950997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.951277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.951553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:53.951676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.952514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:58:53.953344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:53.953988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.954058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 454/890] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:53.954123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.959641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.961231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 437/891] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:58:54.053350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.075514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e51fb-27aa-4f02-838e-7502317e923c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.114904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.115667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.115950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.116228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.116982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.117294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.118715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1dc1-a2ee-4851-9aec-4c8f44d4f51e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.127820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 455/892] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.133799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.183095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf86c8-c894-4605-98e4-26b742ef2a65 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.183402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf86c8-c894-4605-98e4-26b742ef2a65 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.183629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf86c8-c894-4605-98e4-26b742ef2a65 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.185673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 456/893] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:54.190660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.190931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.191221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.203808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.209046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:54.210457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:54.246886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dd9f2-009a-4615-9db1-34d3d9d91309 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.287749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.288877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.289225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.289596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.301481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 457/894] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:54.305720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.307248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.323646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:54.338558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:54.339438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:54.340310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:54.340310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:54.340310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:54.340310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:54.343085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 438/895] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:54.349436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.395554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.441029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ef3c4-a98b-49e6-ae83-0287c063b35c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.479861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318f46a-7169-4990-b9d2-da3e233d6f5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.486356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.487394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.487823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.488794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.489630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.492275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.493070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:54.511647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:54.512794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:54.513851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:54.516923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 458/896] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:54.523530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.528332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.529243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.531513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.534183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.535357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.535833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.538192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.551301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 439/897] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.557416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.647305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ca38-6983-49a0-8bc7-68bee13c2aca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.679168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecde9b-eda2-46fd-be7b-46ca49c58021 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.683629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.692414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.693763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.694305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.694780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.696182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.696704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.698702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.705208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 459/898] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.711405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.719128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.719989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.720266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.720591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.729582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.731182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:54.752039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:54.753029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:54.754013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:54.757474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 440/899] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:54.759875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.802920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.841635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739003e-a340-4955-9af3-9bfd14d11738 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.882872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.884276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.885599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.886077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.887426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.888069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.889918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.896972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 460/900] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.897109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bef56-9dfd-46ef-9815-887af921e420 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.905567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.947444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.948108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.948387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.948659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.949569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.949879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.951747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.970341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.977455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 441/901] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.981110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.022725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0f60-a577-41e5-bd80-d54a51dc1516 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.059206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.059870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.060148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.060426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.061201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] RBAC: Adding query filter params (interface=public, service_id=78688ace8de14f149103f522284bf7b1, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:55.061564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.062994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.073351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 461/902] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/endpoints?service_id=78688ace8de14f149103f522284bf7b1&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:55.074371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.098652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.120347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767d7b5-453e-48ee-81ea-bee3825c87ce None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.163391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.164467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.164944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.165555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.184810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d155726-e5b8-486b-82e7-234c31535b35 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.216112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.230043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.230678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.230959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.231234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.231905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.233330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.245823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 462/903] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:58:55.260346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.262247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.361547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.381561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 442/904] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:55.383938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.491879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205135-cf35-41bf-b16b-fc4f06bd8de4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.526730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.527512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.527793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.528068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.539881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.541691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:55.559878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:55.560903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:55.561885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:55.561885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:55.561885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:55.561885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:55.564298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 463/905] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:55.570384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.682890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998928-417a-442f-b1a3-3b060db4eb76 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.719348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.720018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.720299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.720575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.721314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:55.721650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.723017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213920b-bc6b-4c9a-a8dc-6aab279f50f9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.741093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 443/906] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:55.743093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.789540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.855112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09f730-1a94-4c3b-bf51-e3f994e97a48 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.872096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59e67-c4bf-4565-9843-4410eec56ee1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.872381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59e67-c4bf-4565-9843-4410eec56ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.872664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59e67-c4bf-4565-9843-4410eec56ee1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.874333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 444/907] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:55.879106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.880345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.880345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.900225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:55.901838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:55.902626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.903461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.903745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.904018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.911339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.913734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:55.928976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:55.930074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:55.930989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 464/908] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:55.936830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.962801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.996370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 445/909] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:56.018318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.064054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.070878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08c8e-f190-4a54-9ba1-866d37a0c32f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.115362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.116168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.116451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.116728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.117543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.117854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.119284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919248bd-333b-4648-8576-b43ff3f2c8ee None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.129138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decc0bb-6367-486c-be8d-d4be8429f070 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.135149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 465/910] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:56.135149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0a7f-d004-4e75-bf18-149b698063bd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.135149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0a7f-d004-4e75-bf18-149b698063bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.135149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0a7f-d004-4e75-bf18-149b698063bd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.135149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 466/911] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:56.138344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0a7f-d004-4e75-bf18-149b698063bd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.171815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.172435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.172719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.172998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.173757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.175128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b79ba5-410a-449c-85ed-660f9ddb18be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.193598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 446/912] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:56.193598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.193598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.193598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.223689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:56.225258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:56.264515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0a7f-d004-4e75-bf18-149b698063bd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.267310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.305333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.306580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.307170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.307555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.308650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] RBAC: Adding query filter params (role.id=59999e53454f4e2bb1234d4ad721ef7a, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=486089870c21413b8618845b3217da76) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.309145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.313260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.329405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 467/913] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/role_assignments?user.id=486089870c21413b8618845b3217da76&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=59999e53454f4e2bb1234d4ad721ef7a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:56.329648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 447/914] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:56.345624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.369644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.466253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98c77-923c-42f0-b537-7747751f3a42 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.506339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.507138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.507416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.507690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.508337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.511538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:56.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:56.527071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:56.527926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 468/915] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:56.533235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.634782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158fb2-257e-4aef-97ee-47e014dca3d3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.671970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.672628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.672910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.673189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.673933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.674530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.675893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.681514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 448/916] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:56.687125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.773317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.791947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d22a-7cde-4bcc-b2bb-545e46ea3dc9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.826784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.827443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.827721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.827992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.828688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.828989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.830394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8ee55-e87c-4fe7-b9a1-94a5733ee49c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.835823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 469/917] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:56.841446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.879205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.955529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1397b-f5dc-4889-bb51-6b2877e091db None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.993164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.994651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.995144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.995643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.996690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.998317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a981ec-d835-42cb-93df-38dd3b80ed15 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.021939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 449/918] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:57.442369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e4b1-a7c5-4e33-8a34-9f412e6ab92b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.442891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e4b1-a7c5-4e33-8a34-9f412e6ab92b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.442891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e4b1-a7c5-4e33-8a34-9f412e6ab92b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.445134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 470/919] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:57.450812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.451108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.451393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.468446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:57.469667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:57.560150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 450/920] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:57.582912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e4b1-a7c5-4e33-8a34-9f412e6ab92b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.694667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e4b1-a7c5-4e33-8a34-9f412e6ab92b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.730359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.731161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.731443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.731716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.732359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.733761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:57.746344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:57.747310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:57.748148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 471/921] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:57.753789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.770217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:57.866016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae0469-4290-4494-b633-95bcddd7f74b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.903858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.904982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.905523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.906009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.906920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:57.907434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.909012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.914630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 451/922] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:57.920096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.933299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.031735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e0d0-d60a-4d97-9733-6645193b3ab4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.066982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.067653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.067937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.068743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.069539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:58.069850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.071290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41752-379f-48e9-bb8c-7e85a93ea405 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.076907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 472/923] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:58.086498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.173519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.197952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe80a-b5e5-4ab0-bce6-abf2027a9716 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.232973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.233659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.233943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.234312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.235059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.236422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c877fc-7153-4611-99fe-92e3e2438d38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.257828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 452/924] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:58.422475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d809-ef6d-411f-b576-bc7ccee5a8ac None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.422808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d809-ef6d-411f-b576-bc7ccee5a8ac None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.423037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d809-ef6d-411f-b576-bc7ccee5a8ac None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.424726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 473/925] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:58.430477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052bc0-1b62-4076-b08f-b84f10e9dfcb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.430767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052bc0-1b62-4076-b08f-b84f10e9dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.431047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052bc0-1b62-4076-b08f-b84f10e9dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.450084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-21052bc0-1b62-4076-b08f-b84f10e9dfcb None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:58.451278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-21052bc0-1b62-4076-b08f-b84f10e9dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:58.531272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 453/926] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:58.554869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d809-ef6d-411f-b576-bc7ccee5a8ac None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.600265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8c90-74bc-410f-8200-e6a8851fe319 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.600538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8c90-74bc-410f-8200-e6a8851fe319 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.600807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8c90-74bc-410f-8200-e6a8851fe319 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.602458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 454/927] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:58.607693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.607981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.608269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.626908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:58.628435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:58.640495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.671892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d809-ef6d-411f-b576-bc7ccee5a8ac None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.707503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.712020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.713512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.714533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.715867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.717010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.719713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.729624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 455/928] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:58.734473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:58.735431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:58.736246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:58.744387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 474/929] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:58.746810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.750512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.863788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0b5e-8cd5-4ee1-99d8-a5525f3161bd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.892187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea6e4-27ac-4010-b0f9-c55caa2bb67a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.900867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.901717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.901996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.902270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.909900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.915439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:58.924608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:58.925802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:58:58.926831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:58.933670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 475/930] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:58.935684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.945059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.945834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.946180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.946523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.947304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:58.948042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.949098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.959350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 456/931] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:58.960675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.019667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.070615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988319-5388-4ea5-913e-0c4dcada6ffc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.076000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0e16-8139-49e9-a64b-d9084935cc3b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.110122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.110854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.111206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.111553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.112327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.112701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.114186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7e11-9406-49f1-9c27-a8cae76da0ca None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.120210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 457/932] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.121689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486215b0-77fd-4a3b-aeef-195818215fef None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.122040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486215b0-77fd-4a3b-aeef-195818215fef None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.122385 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486215b0-77fd-4a3b-aeef-195818215fef None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.123589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.123917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 458/933] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:59.124674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.124966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.125253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.126036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.126345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.126814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486215b0-77fd-4a3b-aeef-195818215fef None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.127750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ce0f1-24e7-43b5-8ec6-4146559c01ea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.137226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 476/934] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.138489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.138778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.139060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.158101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:59.160064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:59.221108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.233040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 477/935] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:59.233768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.247051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486215b0-77fd-4a3b-aeef-195818215fef None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.269238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.289371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.290065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.290358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.290634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.291427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] RBAC: Adding query filter params (interface=public, service_id=63c6d507c7c04e38856a7e8ff581848d, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.291739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.293105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.302667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 459/936] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/endpoints?service_id=63c6d507c7c04e38856a7e8ff581848d&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:59.302667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.346799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01777f-5fa7-4d4e-84be-5de54b479d06 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.384817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.386053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.386336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.386614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.398865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.400308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.411642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4a29-dedf-409a-b9c0-669574302db2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:59.418051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.419097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.420144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:59.420144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:59.420144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:59.420144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:59.423919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 478/937] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:59.424896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.451723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.452658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.453134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.453802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.454766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.456473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.458150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING keystone.server.flask.common [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 05:58:59.469740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.479931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:58:59.479931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:58:59.479931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [parameters: {'id': '13743f3bd22c4075ae9f45cd88fa6617', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:58:59.479931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13743f3bd22c4075ae9f45cd88fa6617.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13743f3bd22c4075ae9f45cd88fa6617. Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:59.497297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 05:58:59.498152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() Jun 20 05:58:59.499489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:58:59.500525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:58:59.501476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:59.502276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'id': '13743f3bd22c4075ae9f45cd88fa6617', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.504579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.508001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13743f3bd22c4075ae9f45cd88fa6617. Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 460/938] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jun 20 05:58:59 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:59.511159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.545127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710991-3008-4647-8db1-d5740bda8bed None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.549600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.582629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.583296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.583582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.583910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.584753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.586205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.592693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 479/939] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:58:59.593522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.634442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c187ab-3cd3-4d74-a2fc-56836da64342 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.685286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.686000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.686291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.686574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.687633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.687633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.689288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.710636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 461/940] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.712841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.731657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae1a51-951a-4708-a2d9-5211ba44117a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.741471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.782981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.784143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.784622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.785093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.792891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.794613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:59.811866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.812777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:59.813681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:58:59.815877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 480/941] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:59.822602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.840108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.844821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1f0e-8186-4b97-8a6d-6725a14f650c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.888602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.890046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.890840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.891540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.902544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.904096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:59.920631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.921654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:58:59.922582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 462/942] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:59.931140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.942227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d61f-edc4-452d-a805-4171fea07a7c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.980426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.981088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.981393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.981730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.982435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.982741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.984194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.008197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 481/943] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:00.070238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89c26a-f788-4ce8-99ad-83161625a515 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.110784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.111571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.111810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.112094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.112960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:00.113275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.114882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.137015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 463/944] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:00.142927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.174520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.255140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4da7-ebd1-4b3f-8570-6a6e932cbf0e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.291961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.292760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.293045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.293322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.304427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.305931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8a9fc31e-7c30-41ac-b55a-c34db00a3e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:00.331300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:00.332197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:00.333065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:00.333065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:00.333065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:00.333065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:00.333065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 482/945] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:00.338856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.357856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.448123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4579c-07d2-4ff9-9b3b-75fd4810689f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.461847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b05c9-5574-4ac8-be90-04a3d5e14096 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.462149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b05c9-5574-4ac8-be90-04a3d5e14096 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.462411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b05c9-5574-4ac8-be90-04a3d5e14096 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.464039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 483/946] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:00.468841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.469128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.469439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.485646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.486310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.486595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.486875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.486991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:00.487602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:00.487909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.488117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:00.489276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.501742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 464/947] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:00.507767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.586713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 484/948] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:00.596254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.610198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.620923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.623132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ff02-e8b6-4564-9f75-451edd17b3c0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.661760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.663508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.663797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.664077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.672856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.674622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:00.695027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:00.695949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:00.698079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 465/949] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:00.703635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.735706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5977-125a-49fb-8889-f856d201fd7e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.783251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.784216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.784495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.784765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.786406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.788432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:00.804464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:00.805579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:00.806397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 485/950] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:00.814379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.829505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c75a6-8985-4335-be3e-440427a43d02 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.876523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.877194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.877508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.877789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.878885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:00.879199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.882725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:00.885833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.899835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 466/951] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:00.905269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:00.925761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.953116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639911-312f-4185-b705-e3976a0f2305 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:00.987643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:00.988286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.988566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.988842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.989558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:00.989872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:00.991256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.000870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 486/952] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:01.002749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.031880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1b8e-5a50-4181-8659-6add4e8b30dc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.079701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.081072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.081611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.082124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/486089870c21413b8618845b3217da76/roles/59999e53454f4e2bb1234d4ad721ef7a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.085545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=486089870c21413b8618845b3217da76, role_id=59999e53454f4e2bb1234d4ad721ef7a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.087222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba23748-2e98-4828-9b19-87b6622d826c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.102514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 467/953] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:00 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/486089870c21413b8618845b3217da76/roles/59999e53454f4e2bb1234d4ad721ef7a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:59:01.135663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4905f1-00ea-4f92-b06d-2419439216f9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.174756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.175850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.176366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.176891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.178439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:01.179066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.180731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3a90c-85f3-4ee7-9648-55910b5f7225 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.183627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:01.188700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 487/954] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:01.784191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8dc7-d807-4244-a16f-d67678cfb314 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.784717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8dc7-d807-4244-a16f-d67678cfb314 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.784717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8dc7-d807-4244-a16f-d67678cfb314 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.786405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 468/955] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:01.792049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.792891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.793403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.814264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:01.815800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:01.890923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 488/956] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:01.915957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8dc7-d807-4244-a16f-d67678cfb314 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.979507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.033971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8dc7-d807-4244-a16f-d67678cfb314 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.071348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.072365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.072814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.073254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.074106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.075727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-80df4c94-8346-4dff-8278-8ef2f4f49000 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.088552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:02.089850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.090748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 469/957] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:02.096775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.204317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d833-2685-4e4a-835f-df04616c0978 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.235580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.242976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.244068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.244601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.245232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.245979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.246288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.247681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.251014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ecade-e8c4-40e6-b93d-e2f1e647d530 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.251563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ecade-e8c4-40e6-b93d-e2f1e647d530 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.252048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ecade-e8c4-40e6-b93d-e2f1e647d530 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.255164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 470/958] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:02.257810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 489/959] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:02.260759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.261586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.262080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.262558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.282565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:02.284582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:02.381614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 471/960] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:02.392419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8cf8-61a3-42f0-bc7f-413453bbf672 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.402623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.440282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.440967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.441256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.441572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.442281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.442590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.444601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.451437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 490/961] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:02.458549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.460491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.516531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee868f-b0a2-4127-a730-cff3bf8aba2a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.535324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.555817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.556822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.557168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.557553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.558312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.559829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.574033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:02.574033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:59:02.574033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [parameters: {'user_id': '7ad0605886d845768d4785eb23285c80', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:59:02.574033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:02.582670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:02.583561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:59:02.584590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:59:02.585583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:02.586487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:02.588331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'user_id': '7ad0605886d845768d4785eb23285c80', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.589813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 05:59:02.590862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 472/962] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:02.592676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.600176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b32b4-73bd-427f-9573-688e9e74c55a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.651907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.652668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.653023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.653386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.654387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.656013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.684126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 491/963] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:02.722309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388793-fd86-4e5c-8e1b-e5d54288ba40 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.739416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.776540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.777339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.777649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.777921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.786625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.788745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-49bcf657-3a3f-4da6-b8d8-6567f62a527c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:02.805646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:02.806653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:02.807591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 473/964] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:02.813112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.934444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf83ea-a10a-49e5-8abb-1d14d0a0bc94 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.949490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.973274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.974072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.974406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.975908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.976708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.977069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.978553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa813db-dbf1-45d0-87c4-4d7f17a590df None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.022077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 492/965] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:03.215055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d0556-fd5f-46af-a4b4-bcf7259305fc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.215396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d0556-fd5f-46af-a4b4-bcf7259305fc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.215576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d0556-fd5f-46af-a4b4-bcf7259305fc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.217160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 474/966] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:03.222921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cac5a-b19c-434f-83f2-63aa038a0397 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.223209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cac5a-b19c-434f-83f2-63aa038a0397 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.223493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cac5a-b19c-434f-83f2-63aa038a0397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.242333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-202cac5a-b19c-434f-83f2-63aa038a0397 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:03.243591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-202cac5a-b19c-434f-83f2-63aa038a0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:03.323099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 493/967] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:03.346317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d0556-fd5f-46af-a4b4-bcf7259305fc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.386710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68eafb-2c6f-4a88-8e00-5dca716bc85f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.387076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68eafb-2c6f-4a88-8e00-5dca716bc85f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.387430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68eafb-2c6f-4a88-8e00-5dca716bc85f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.389044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 494/968] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:03.394345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.394643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.394931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.412433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:03.413729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:03.457194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d0556-fd5f-46af-a4b4-bcf7259305fc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.488514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 495/969] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:03.499267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.500077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.500360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.500635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.511401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:03.513053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:03.519650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:03.520729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:03.523460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 475/970] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:03.527519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.553041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.559959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.624409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c777c2-9012-4415-aeaf-bc9645e892c5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.636644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e4489-c4e8-4991-a3cc-f81633c3ebad None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.661632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.662338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.662622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.662895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.663629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.665011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.674108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.674783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.675072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.675354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.676203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:03.676421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.678359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.688263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 496/971] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:03 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:03.689700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 476/972] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:03.692759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.802814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.826140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0f54-8528-41f5-8b58-9f42b2c97774 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.865010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.865866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.866151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.866432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.878126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.879853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:03.899841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:03.900803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:03.901794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:03.901794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:03.901794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:03.901794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:03.901794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 497/973] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:03.908260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.008215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.019473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df98a2-812e-47e0-a791-2d830ac2d64c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.053745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.054406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.054688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.055007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.055822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.056171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.057558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.070242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 477/974] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:04.075666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.177324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144eaa-ea12-44fe-817f-2c82f7d081cd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.212636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.213470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.213754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.214028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.221210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.222679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.225427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:04.239193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:04.240882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:04.242222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:04.245578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 498/975] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:04.246819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.362617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e7d35-413b-4ce5-8365-5575441c35a5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.398783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.399452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.399737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.400016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.400856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.401166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.402629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.424924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 478/976] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:04.426811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.528490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50027fc-de71-46f7-94cb-1b1cd499fdab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.562940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.563635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.563929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.564232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.633958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.637579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.639287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28e4d-5430-40a4-b6a3-57441ea3d487 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.742241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 499/977] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:04.744092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.754822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.801899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3670-ec61-42d1-865a-1abb554e8c00 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.802214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3670-ec61-42d1-865a-1abb554e8c00 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.803078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3670-ec61-42d1-865a-1abb554e8c00 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.804465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 500/978] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:04.809989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.810276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.810562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.827864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:04.829048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:04.848405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba56c-ed8c-4d5a-9876-690f308c2ef3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.888533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.889237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.889551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.889825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.901650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.905422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 501/979] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:04.905554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:04.922394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:04.923780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:04.924690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:04.924690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:04.924690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:04.924690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:04.925347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.929036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 479/980] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:04.930394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.958883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.001271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.033056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06c705-a954-4524-95e4-37e0f3c24241 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.044669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367da23-d4f6-4e5d-b7d4-724cd14d0a95 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.069699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.070628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.070921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.071199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.071860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.073279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.081410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.082246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.082669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.083097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.084023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.084473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:05.085417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:05.086546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:05.087568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 502/981] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:05.089181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.092292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.103766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 480/982] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.109211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.194334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.202526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168000-a1f5-43d2-9e05-63fef5eeb3ab None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.212923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2869f-bb75-44b8-88db-7a8b488e2f8a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.233674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.242509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.243178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.243468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.243750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.244453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.244767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.246182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.250231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.255651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 503/983] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.255804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.255804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.255804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.256766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.261465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.262910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:05.277328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:05.278237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:05.279117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 481/984] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:05.284039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.376883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068040fd-65c4-4f43-bb58-0a4ec1eb14c1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.399315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c468-cdbb-45f4-abcf-d3282e72a0cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.414012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.414677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.414959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.415235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.415932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.416356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.417746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.423616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 504/985] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.429045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.435361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.436018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.436298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.436569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.437356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.438104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.439520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.454007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.456055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 482/986] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.462032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.508183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.538769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b0313-f482-4342-9f25-abb09edd776b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.573312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.573902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea00c-b0c9-44cd-a645-502b526156b6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.574011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.574267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.574547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.575351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] RBAC: Adding query filter params (interface=admin, service_id=63c6d507c7c04e38856a7e8ff581848d, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.575671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.577064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.582377 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 505/987] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/endpoints?service_id=63c6d507c7c04e38856a7e8ff581848d&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.588037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.615592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.616349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.616630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.616909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.618044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] RBAC: Adding query filter params (role.id=59999e53454f4e2bb1234d4ad721ef7a, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=486089870c21413b8618845b3217da76) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.618382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.619802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51157cfa-bfc3-4ef9-9928-486a0363f29a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.633448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 483/988] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/role_assignments?user.id=486089870c21413b8618845b3217da76&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=59999e53454f4e2bb1234d4ad721ef7a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.686699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.704432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120b25-5bb4-4669-a27a-87ab24679c03 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.741879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.742959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.743469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.743782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.744489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.746319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db5b08-128c-4574-9283-fcae61fe8330 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.761067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 506/989] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:59:05.819376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382595-a160-47b5-8ffc-f98900f42bb7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.819608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382595-a160-47b5-8ffc-f98900f42bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.819935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382595-a160-47b5-8ffc-f98900f42bb7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.821327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 484/990] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:05.827135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.827425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.827705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.847015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:05.848259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:05.923794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 507/991] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:05.946732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382595-a160-47b5-8ffc-f98900f42bb7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:06.052279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382595-a160-47b5-8ffc-f98900f42bb7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:06.054869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:06.090147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:06.090945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.091227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.091500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.092159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:06.093553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:06.105561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:06.106568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:06.107428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:06.109453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 485/992] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:06.112951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:06.197547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:06.218063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae35b9c-f927-4c2c-b93a-50cf32d72b79 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:06.252562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:06.253228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.253536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.253809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.254505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:06.254804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:06.256702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:06.266058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 508/993] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:06.267553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:06.370891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15c94-eae3-4ace-97f1-348301fe90c5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:06.405223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:06.405910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.406190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.406466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.407168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:06.407473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:06.408836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:06.417451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 486/994] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:06.420507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:06.520776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651e7c-7e54-436e-a98a-e0d9a9f1a55c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:06.554908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:06.555555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.555836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.556162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.556937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] RBAC: Adding query filter params (interface=public, service_id=4795a2d3cbb14d91bd228c9823228afa, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:06.557244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:06.558648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2bed8-92fd-43cd-ba71-0c6690552bb7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:06.563700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 509/995] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:06 2022] GET /identity/v3/endpoints?service_id=4795a2d3cbb14d91bd228c9823228afa&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:06.569302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:06.601509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:06.669364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6f206-5d54-4aad-a484-260de0593beb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:06.702352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:06.703010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.703289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.703560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.704255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:06.705631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71982b-b987-41c7-8989-29505d55ade4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:06.712169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 487/996] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:06 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:59:07.742874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16220-90de-4a0b-b7b5-da1ac2cc1b8f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.743404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16220-90de-4a0b-b7b5-da1ac2cc1b8f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.743404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16220-90de-4a0b-b7b5-da1ac2cc1b8f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.744836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 510/997] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:07.750013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a6cc-3407-4f15-94de-45addaf3772c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.750406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a6cc-3407-4f15-94de-45addaf3772c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.750568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a6cc-3407-4f15-94de-45addaf3772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.768093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1225a6cc-3407-4f15-94de-45addaf3772c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:07.769626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1225a6cc-3407-4f15-94de-45addaf3772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:07.841415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 488/998] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:07.852150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ec09-0a53-41b1-abaf-2f0b2e88f8bd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.852439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ec09-0a53-41b1-abaf-2f0b2e88f8bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.852722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ec09-0a53-41b1-abaf-2f0b2e88f8bd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.854241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 511/999] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:07.859159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.859454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.859739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.863615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6ec09-0a53-41b1-abaf-2f0b2e88f8bd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.874740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.877631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:07.878837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:07.903606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.953240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 489/1000] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:07.977065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.986369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6ec09-0a53-41b1-abaf-2f0b2e88f8bd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.025414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.026279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.026563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.026839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] PATH_INFO: `/v3/services/image` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.027485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.028851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.041120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.042125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:08.046209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 512/1001] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:08.048040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.087943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f333fd-fab9-4a31-81ea-8813ab9fad7d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.123651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.125025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.125902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.126182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.126462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.127103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.128464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.141873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.142897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.143764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:08.148939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 490/1002] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:08.149900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.158654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5b0-024a-4e08-ba62-6477dbb3449c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.173600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.195743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.196779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.197067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.197344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.198066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] RBAC: Adding query filter params (name=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.198383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.200042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.204947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 513/1003] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.211047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.265785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a7cc-c4ec-4f57-8196-87bc7b1c957c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.301608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.303093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.303585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.304066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.305412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.305931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.307934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.317150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0b7d-e30c-40dc-8573-9e8c2475ec12 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.318548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 491/1004] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.324185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.355126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.355789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.356224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.356504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.357721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] RBAC: Adding query filter params (type=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.358149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.359975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.362737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.381844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 514/1005] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:08.421357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.440107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6707-804e-4506-bf71-4bcc9eb75e44 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.476969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.477705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.477992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.478273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.479003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.479315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.480710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ec34c-16cb-4ba3-a1e1-0759aa1c7504 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.492006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 492/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.493143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.596793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21442-354f-4f2e-93f0-780115ee6619 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.629731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.630403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.631422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.631702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.632452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.633966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77183e3-3490-40d8-b363-b28e4071ee7c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.661407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 515/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:08.745788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6102-b622-468c-b982-11d49f8d83dd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.746122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6102-b622-468c-b982-11d49f8d83dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.746399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6102-b622-468c-b982-11d49f8d83dd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.747941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 493/1008] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:08.753584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.754095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.754169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.772431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:08.773931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:08.834869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.854160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 516/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:08.877240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6102-b622-468c-b982-11d49f8d83dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.982291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6102-b622-468c-b982-11d49f8d83dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.016111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.016896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.017172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.017467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.018117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.019500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:09.031987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:09.033006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:09.033909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:09.037560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 494/1010] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:09.039929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.139655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903adb-722d-4fdf-b13a-14ae5de068ec None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.173784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.174431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.174709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.174977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.175678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:09.176009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.177978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.185713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 517/1011] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:09.189139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.205418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:09.295408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c317-a77f-49e0-9239-e4e81f4fa02e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.336666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.337331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.337647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.337923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.338630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:09.338942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.340299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e5e19-bdb4-4b25-8314-8a0319f7cc65 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.349907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 495/1012] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:09.351982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.405219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:09.456605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097e3e-99c8-4dbd-9bb9-9ebbcd952578 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.494576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.495258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.495542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.495818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.496581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.498008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef746f-8c9a-4761-88d7-0670148d753b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.525417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 518/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:10.425888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5bf50-609c-4b57-bd30-87010535c110 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.426405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5bf50-609c-4b57-bd30-87010535c110 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.426483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5bf50-609c-4b57-bd30-87010535c110 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.428565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 496/1014] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:10.433541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf073ee-77b3-4587-b570-13e8720b8cd7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.433936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf073ee-77b3-4587-b570-13e8720b8cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.434122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf073ee-77b3-4587-b570-13e8720b8cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.450433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1cf073ee-77b3-4587-b570-13e8720b8cd7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:10.451599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1cf073ee-77b3-4587-b570-13e8720b8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:10.522901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 519/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:10.545922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5bf50-609c-4b57-bd30-87010535c110 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:10.624614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:10.650357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5bf50-609c-4b57-bd30-87010535c110 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:10.684653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:10.685315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.685620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.685895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.686624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:10.687977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73b30-325c-446d-81cb-c1287c3ae31a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:10.709200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 497/1016] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:10 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:10.760820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e700c-36d8-46cb-972e-fa1b1c01c51f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.761163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e700c-36d8-46cb-972e-fa1b1c01c51f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.761416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e700c-36d8-46cb-972e-fa1b1c01c51f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.763027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 520/1017] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:10.768599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.768885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.769159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.787692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:10.788915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:10.869046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 498/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:10.893697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e700c-36d8-46cb-972e-fa1b1c01c51f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:10.928365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.001147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e700c-36d8-46cb-972e-fa1b1c01c51f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.035502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.036289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.036586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.036919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.038058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.039490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c75d5-2587-448e-9617-96f36c1a1d9a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.041081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 521/1019] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:11.046943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.110403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.151537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e40b8-8a0d-4312-98ff-d41a614e8420 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.185080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.185777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.186054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.186326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.187041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.188463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2aed-431f-43eb-a86b-c24595a99d2d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.217044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 499/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:11 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:11.687498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf2d5-fedf-457a-9693-95cbd4b77d04 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.688042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf2d5-fedf-457a-9693-95cbd4b77d04 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.688042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf2d5-fedf-457a-9693-95cbd4b77d04 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.689586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 522/1021] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:11.694786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.695216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.695351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.714161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:11.716531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:11.784566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 500/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:11.810581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf2d5-fedf-457a-9693-95cbd4b77d04 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.914964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.920123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf2d5-fedf-457a-9693-95cbd4b77d04 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.954238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.954958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.955240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.955513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.966220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:11.974486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:11.975380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:11.976201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 523/1023] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:11.981701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.030538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.087580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bbea1-3210-4f59-911e-b06d414adf27 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.122391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.123049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.123331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.123607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.124343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.124647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.126032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.134314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 501/1024] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:12.139777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.239551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa53857-fdc5-41b6-a1c8-27b61f5039e8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.272650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.273720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.274000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.274270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.284613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.286073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:12.303334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:12.304244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:12.305156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:12.305156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:12.305156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:12.305156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:12.305970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 524/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:12.310788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.418295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c073-7d4c-494b-8cb8-bc931d24226a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.425547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.454637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.455299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.455585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.455865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.456587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.456894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.458296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.475355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 502/1026] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:12.476577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.492576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.579630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867354-5ea3-47cd-b936-0ca75b88f686 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.613990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.614809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.615292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.615574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.622928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.624362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:12.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:12.639042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:12.640015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:12.641165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 525/1027] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:12.644889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.746607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0df04-f89f-4696-84ef-d0b5cf8cfcca None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.783082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.783751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.784030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.784304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.785140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.785473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.787606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f69f-5c45-4900-a258-b4ed1d5af143 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.811937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 503/1028] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:12.813124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.816140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7dd03-21a3-4464-bb40-4b5bae1d9316 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.816276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7dd03-21a3-4464-bb40-4b5bae1d9316 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.816518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7dd03-21a3-4464-bb40-4b5bae1d9316 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.817903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 504/1029] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:12.822970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.823267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.823548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.840656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:12.841926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:12.861098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.889007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.921720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 505/1030] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:12.922507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a975-63ad-42e3-9318-3570f3988728 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.945946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.960330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.960989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.961266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.961579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.034493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.036287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.057091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dbf5-3fa9-44cc-bd76-1f628c40dbb2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.098684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.100040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.100328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.100600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.101262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.102657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:13.114419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:13.116198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:13.117045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 506/1031] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:13.122050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.126309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.144646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.162236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 526/1032] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:13.168005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.231520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e8a1b-c110-4202-aa6d-24073ba02c15 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.268303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.268964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.269243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.269549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.270253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.270559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.272038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.277629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 507/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.283072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.283275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3385-31cf-4571-8777-b407e8867f15 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.320217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.320913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.321197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.321509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.332221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.333756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-933f7102-12f5-424e-bf2d-9914bf1ac509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:13.351379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:13.352301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:13.353211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:13.353211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:13.353211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:13.353211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:13.353211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 527/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:13.353823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05787a-94f5-4f76-b8ab-3337aaf58627 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.354109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05787a-94f5-4f76-b8ab-3337aaf58627 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.354382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05787a-94f5-4f76-b8ab-3337aaf58627 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.355783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 528/1035] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:13.358359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05787a-94f5-4f76-b8ab-3337aaf58627 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.370617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.384916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.390399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbc3e-54c8-493e-948b-ec50d2a912aa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.426907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.428114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.428393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.428662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.429359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.429700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.431049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23ffdd-1e55-4ed0-9772-43bcdccbef86 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.435996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 508/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:13.437280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.437622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.437906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.454354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:13.455549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:13.467072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05787a-94f5-4f76-b8ab-3337aaf58627 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.500434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.501091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.501372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.501671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.502373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.502677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.504044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.515619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 529/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:13.516388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.522648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 509/1038] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:13.523746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.602368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.607829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.618767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad78c8-f2a6-4ced-9e05-6c844aa2a789 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.631657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55a2d9-db38-42d4-86b8-b7864da1d1a3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.652042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.652688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.652970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.653248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.654055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] RBAC: Adding query filter params (interface=public, service_id=ebd2fb7c02d5473f94a1bab95cf49b97, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.654361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.655726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.660696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 530/1039] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/endpoints?service_id=ebd2fb7c02d5473f94a1bab95cf49b97&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.661495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.666375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.667194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.667476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.667757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.674505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.675942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:13.689858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:13.690857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 510/1040] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:13.691769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.768981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255792-a432-4002-8dcd-6a38c2bdf0b4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.792060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84d50-2cdd-4a18-9df1-4af7cc3f9e9c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.802788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.803570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.803851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.804127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.805289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.806750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.808336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 531/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.809083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.827222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.827869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.828065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.828534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.828534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.829343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.830500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.832243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.839276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 511/1042] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:59:13.841039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.925916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117dc84-5591-4606-90db-01b477c25754 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.954991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15da9-14fb-4284-99f9-0ad174a41c55 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.965874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.966858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.967151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.967435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.968235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.968550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.970200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.984755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 532/1043] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.991536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.998409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.999083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.999361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.999634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.000338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.001790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bba94-9edf-42d8-a499-de83fedd1f86 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.026298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 512/1044] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:13 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:14.087099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:14.113482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e21ad-7bed-472d-ad64-310940b84761 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:14.151758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:14.152427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.152706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.152981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.153869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] RBAC: Adding query filter params (role.id=59999e53454f4e2bb1234d4ad721ef7a, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:14.154179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.155646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996c4e-56c7-485f-8552-d3df7b6147c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.164122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 533/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=59999e53454f4e2bb1234d4ad721ef7a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:15.900146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d85-c208-4015-9e97-0a9d4fd56783 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.900701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d85-c208-4015-9e97-0a9d4fd56783 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.900701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d85-c208-4015-9e97-0a9d4fd56783 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.902106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 513/1046] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:15.907174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868615-9578-4869-81d4-0950d85abe77 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.907563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868615-9578-4869-81d4-0950d85abe77 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.907732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868615-9578-4869-81d4-0950d85abe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.924823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7c868615-9578-4869-81d4-0950d85abe77 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:15.926016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7c868615-9578-4869-81d4-0950d85abe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.994148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 534/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:16.016417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53d85-c208-4015-9e97-0a9d4fd56783 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.075899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.124165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53d85-c208-4015-9e97-0a9d4fd56783 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.149118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d802-0098-4324-8fc7-267fbab77b9d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.149581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d802-0098-4324-8fc7-267fbab77b9d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.149858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d802-0098-4324-8fc7-267fbab77b9d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.151408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 535/1048] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:16.157287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd005-95f2-443b-9d40-22929ab100e8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.157611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd005-95f2-443b-9d40-22929ab100e8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.157895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd005-95f2-443b-9d40-22929ab100e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.165192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.166222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.166648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.167065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.167862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.169910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.174599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-213cd005-95f2-443b-9d40-22929ab100e8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:16.175780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-213cd005-95f2-443b-9d40-22929ab100e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3bbba077-86b9-471d-b688-6b380c88043e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:16.185048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:16.186312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:16.187249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 514/1049] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:16.188771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b114-466f-448b-b257-f01cb8bb320c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.189051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b114-466f-448b-b257-f01cb8bb320c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.189325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b114-466f-448b-b257-f01cb8bb320c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.190723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 515/1050] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:16.192578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b114-466f-448b-b257-f01cb8bb320c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.240606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.246529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 536/1051] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:16.247773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.248083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.248360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.265078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:16.266301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:16.296838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b114-466f-448b-b257-f01cb8bb320c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.317236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.332686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.333402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.333810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.334093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.334808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.335118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.336482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.337785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 537/1052] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:16.338620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.345817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 516/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:16.346809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.442050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62ebe3-3fae-4f09-b800-8869eeb73cfc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.443142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c94b78-fe43-4ae6-808f-c8577d541cc3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.470308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.477750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.477914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.478401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.478679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.478771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.478952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.479043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.479227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.479656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.479959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.481312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.486255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 517/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:16.487008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.489221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:16.497074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:16.498272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 538/1055] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:16.499119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.541930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.592374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a947-21bc-451e-a664-06fccea97f70 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.600740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499546b6-665d-4606-a2eb-0e26a04081dc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.627277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.628070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.628345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.628613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.634832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.635484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.635766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.636044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.636779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.638189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.638464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:16.646624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:16.647957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 518/1056] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:16.649278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.661086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 539/1057] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:16.662459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.717205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.767089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833760a0-b27f-47f9-b55c-34e48df84b71 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.777591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.793678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1995-3027-46d4-ab51-95f6a6ce5b00 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.807185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.807854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.808134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.808408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.809427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.809549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.810831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.825174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 519/1058] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:16.826761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.837683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.838360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.839355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.839355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.840343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.840660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.842981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.853871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 540/1059] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:16.859073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.936794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efeffa-a845-43db-8fd3-458157d2b024 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.968691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc37424-5868-47e8-8c7d-ec076004ec51 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.971920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.972107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.972990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.973204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.973501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] PATH_INFO: `/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.989480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] RBAC: Authorizing `identity:get_user(user_id=3a52e13c505a43dcb0ffdeee1fc162bd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.991544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.997820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 520/1060] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:16.998909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.010207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.011006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.011297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.011577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.022495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.024210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.029555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:17.042072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:17.043209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:17.044306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:17.044306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:17.044306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:17.044306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:17.048193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 541/1061] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:17.049027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.115391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf02c-3b90-4eea-84fb-9a69314bb7af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.151337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.151548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.151682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.151962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.158941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fc93a-534f-4182-bfa1-c8cba51e0ef3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.195573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.196223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.196500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.196772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.197517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:17.197828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.199238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.212275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 542/1062] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:17.217705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.227696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.229148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.237216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.262237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.326015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d675-9921-419f-a0fb-61e56147263a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.355387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 521/1063] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:17.356952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.363269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.364061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.364348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.364754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.372682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.374163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:17.389095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:17.390246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:17.391192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 543/1064] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:17.395877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.466973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef28a-bba0-48cc-98d8-a04b53583753 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.481574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.496561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.504923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.505873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.506159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.506441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.507623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.508521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173414f-ac00-400a-a9fb-418aa529256b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.509070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.511529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 522/1065] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:17.516601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.547633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.548309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.548593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.548870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.549732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:17.550045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.551481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.570979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 544/1066] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:17.576380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.628438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757a87-3576-41a8-ad9c-1d34f111dc91 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.663584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.664243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.664528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.664809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.665676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=fc06233e42014e669193ea872656b173, user.id=3a52e13c505a43dcb0ffdeee1fc162bd) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:17.665989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.667417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.673004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 523/1067] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/role_assignments?user.id=3a52e13c505a43dcb0ffdeee1fc162bd&scope.project.id=fc06233e42014e669193ea872656b173&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:17.699245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7f7c-95dc-4011-8775-1b0244c83bd7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.738592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.739318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.739657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.740082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.742397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.753529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.755023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:17.775011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:17.776013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:17.776908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:17.776908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:17.776908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:17.776908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:17.781092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 545/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:17.782436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.850421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.892032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84760-2b99-4e0c-8b88-3b972eb7edf9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.925307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.925994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.926274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.926545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.927905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:17.928207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.929708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.945955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 524/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:17.947927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.049698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523fbdf-f4a6-42d0-8f6a-504b044bf027 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.084029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.085260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.085571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.085847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.092866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.094348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:18.108241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:18.109143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:18.110051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:18.111345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 546/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:18.115481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.217968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4b17-cb18-4a36-b95d-9f871bde3317 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.237907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.252818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.253507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.253789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.254062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.254838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:18.255679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.257646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b34b3-85ed-44a5-8ada-f35fabfc0c4b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.274605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 525/1071] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:18.275903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.329066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.386580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb270c-435a-4f1f-b976-e71b17b8789a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.420399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.421285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.421595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.421873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/59999e53454f4e2bb1234d4ad721ef7a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.424036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=115ba46eabce4863a597ad69bca1703c, role_id=59999e53454f4e2bb1234d4ad721ef7a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.425500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383d9a-bd5a-4b8b-80f2-6da26dae6e98 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.440415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 547/1072] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:18 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/115ba46eabce4863a597ad69bca1703c/roles/59999e53454f4e2bb1234d4ad721ef7a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:18.747163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a992cf-0678-412f-a02b-f9c290c01bac None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.747554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a992cf-0678-412f-a02b-f9c290c01bac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.747759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a992cf-0678-412f-a02b-f9c290c01bac None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.749250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 526/1073] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:18.754184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.754474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.754748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.773237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.774490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.845962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 548/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:18.868007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a992cf-0678-412f-a02b-f9c290c01bac None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.974054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a992cf-0678-412f-a02b-f9c290c01bac None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.007898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.008476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.008759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.009114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.057813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.078620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.080075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.181092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 527/1075] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:19.186798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.221636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.289889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c46d7-f591-4c2e-b170-7a8301bbc293 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.329704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.330484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.330769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.331045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.342724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.344179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e53656db-7a6a-406c-b981-e3231553ffc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:19.362950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:19.363843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:19.364750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:19.364750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:19.364750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.364750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:19.364750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 549/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:19.371011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.463448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.488354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b8ddf-6d13-4f01-8bed-2516b01d3404 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.525303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.529414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.529414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.529414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.531916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:19.532285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.533730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83693f9-f864-425b-9afd-54837596ea05 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.549521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 528/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:19.737182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a373bb8-3e0d-4645-8aba-ec023590379e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.737588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a373bb8-3e0d-4645-8aba-ec023590379e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.737693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a373bb8-3e0d-4645-8aba-ec023590379e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.739078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 550/1078] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:19.745334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.745669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.745954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.763523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:19.764702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:19.846606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 529/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:19.870547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a373bb8-3e0d-4645-8aba-ec023590379e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.956592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.969986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a373bb8-3e0d-4645-8aba-ec023590379e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.002849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.003627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.003906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.004179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.014153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:20.022185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:20.023500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:20.024338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 551/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:20.029646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.100302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.131930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5f93-2623-45e8-8cd4-9f099d0bea4c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.167205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.167859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.168135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.168405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.169139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:20.169466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.170817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.178813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 530/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:20.184463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.281544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9138dd-b1a7-4c30-a60c-256e2d10265c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.313655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.314516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.314791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.315058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] PATH_INFO: `/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.316233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] RBAC: Authorizing `identity:get_user(user_id=3a52e13c505a43dcb0ffdeee1fc162bd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.318244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.319933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 552/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:20.325942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.424955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f267-6930-426c-bd48-429a44a0e795 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.454215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.460029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.460873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.461146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.461439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.462599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.464013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964ffa-8bdf-4c3d-9536-cd03425e52b0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.465727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 531/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:20.471430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.490815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.514304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3897ae-c82d-4210-bbb4-fa30ad5f6577 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.514593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3897ae-c82d-4210-bbb4-fa30ad5f6577 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.514875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3897ae-c82d-4210-bbb4-fa30ad5f6577 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.516247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 532/1084] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:20.521021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.521408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.521608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.539056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:20.540313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:20.573065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ee85-e5dc-4a01-96cd-d7c1e8b1254f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.606659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.607568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 533/1085] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:20.607713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.607896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.608235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173/users/3a52e13c505a43dcb0ffdeee1fc162bd/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.610290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc06233e42014e669193ea872656b173, user_id=3a52e13c505a43dcb0ffdeee1fc162bd, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.611743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.625126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 553/1086] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:20 2022] PUT /identity/v3/projects/fc06233e42014e669193ea872656b173/users/3a52e13c505a43dcb0ffdeee1fc162bd/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:59:20.631329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.741063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fd4d5-a4f5-41f2-ba9a-bec53e9bd2e6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.772017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.780032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.781081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.781361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.781662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.792607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:20.800821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:20.802011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:20.803085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 534/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:20.808768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.885417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.908794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c095d-d256-4130-be4f-ada326fcfb2f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.941711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.942378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.943221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.943505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.944251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:20.944559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.945966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.953954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 554/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:20.960345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.060828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd6c89-9b1a-4916-8cb2-6e6cf3ebf441 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.094285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.095069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.095347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.095617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.106563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.107993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:21.125074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:21.126227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:21.127123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:21.127123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:21.127123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:21.127123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:21.127123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 535/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:21.133415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.230599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1a60-8242-47f9-97cf-b4a57d2de554 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.263244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.263889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.264166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.264435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.265143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:21.265476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.266837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.273946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.279956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 555/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.285433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.332489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.387645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1f44-31b9-4f96-bec7-9ca15767b9e3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.420571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.421340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.421647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.421921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.429192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.430650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:21.444201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:21.445288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:21.446805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 536/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:21.451087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.548471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42def79e-3a47-41a4-872c-d68174b85800 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.581603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.582193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.582478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.582756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.584124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:21.584433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.585899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.602954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 556/1092] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.608639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.707972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7e0f-c6cd-4ff2-833c-d60b496f88c9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.709565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.745154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.745831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.746110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.746384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.812682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.814156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.912933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 537/1093] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:21.918506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.973433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.016395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37433-77ee-4e9c-a50a-3a2e4a3ad50b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.049836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.050632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.050908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.051175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.062630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.064091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:22.081505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.082527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.083453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:22.083453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:22.083453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:22.083453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:22.083453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 557/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.088329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.090707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.189121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9e14-05ba-40c4-acd3-3fb51cc223b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.222957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.223608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.224488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.224758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.225502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.226008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.228462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.240321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 538/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.245784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.347254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bb752-3aef-496e-9b6a-c8c6f8978395 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.357519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.382121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.382907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.383188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.383460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.389946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.391387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:22.405555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.406568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:22.407833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 558/1096] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.413159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.479737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.518533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e77f12-fa6f-4072-b0b6-15744d4f71e9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.552047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.552690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.552971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.553249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.554198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.554514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.555944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8ced0-1aad-4595-a80a-e4ad6509fb6c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.568428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 539/1097] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.574610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.659279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761dd4-72c8-4747-aa9c-2e5143fcfac6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.659592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761dd4-72c8-4747-aa9c-2e5143fcfac6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.659874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761dd4-72c8-4747-aa9c-2e5143fcfac6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.661289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 540/1098] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:22.666590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.666874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.667149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.673629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b944a-7dac-4b52-a7ca-9e3811fdfb20 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.683144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:22.684314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.707662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.709022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.709399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.709703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.710530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] RBAC: Adding query filter params (role.id=59999e53454f4e2bb1234d4ad721ef7a, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=115ba46eabce4863a597ad69bca1703c) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.710844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.712282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.718107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 559/1099] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/role_assignments?user.id=115ba46eabce4863a597ad69bca1703c&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=59999e53454f4e2bb1234d4ad721ef7a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.762032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 541/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:22.788091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.826474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.906985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5064d-de3a-464c-821e-48ee2541bb8c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.941521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.942314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.942700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.942977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.953326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:22.961479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.962442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:22.963282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 560/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.968751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.024880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.076651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532172-e269-46ad-9f37-93b7984ad550 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.115677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.116356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.116644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.116925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.117800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.118111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.119930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.130691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 542/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:23.136770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.234949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.245202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ab822-168a-4a15-9ade-c8088588a061 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.279215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.280003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.280280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.280547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] PATH_INFO: `/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.281755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] RBAC: Authorizing `identity:get_user(user_id=3a52e13c505a43dcb0ffdeee1fc162bd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.283194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.284800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 561/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/users/3a52e13c505a43dcb0ffdeee1fc162bd => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:23.291049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.396583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee870-cee3-4a26-8219-c12ffc09e766 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.410623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.432451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419395d-438a-4596-9767-43425f314b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.433096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419395d-438a-4596-9767-43425f314b8c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.433403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419395d-438a-4596-9767-43425f314b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.433690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419395d-438a-4596-9767-43425f314b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.502520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419395d-438a-4596-9767-43425f314b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.503976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419395d-438a-4596-9767-43425f314b8c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.606153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 543/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:23.611898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.708637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2325-c5f2-4429-a7ff-a0cf9f29da22 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.740804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.741658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.741937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.742209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.743359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.744773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d852fa-13b5-49f4-996c-ed2d69cb7e0d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.746433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 562/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:23.752335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419395d-438a-4596-9767-43425f314b8c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.767632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.850163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419395d-438a-4596-9767-43425f314b8c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.884468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.885185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.885500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.885850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.887188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=fc06233e42014e669193ea872656b173, user.id=3a52e13c505a43dcb0ffdeee1fc162bd) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.887736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.889175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c0280-6836-4efe-872b-e31b286a9b01 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.895359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 544/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/role_assignments?user.id=3a52e13c505a43dcb0ffdeee1fc162bd&scope.project.id=fc06233e42014e669193ea872656b173&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:25.952036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e894-cef7-460b-8c86-308d133dba40 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.952682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e894-cef7-460b-8c86-308d133dba40 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.952682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e894-cef7-460b-8c86-308d133dba40 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.953971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 563/1107] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:25.959688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.960121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.960228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.977140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:25.978353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:26.042463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 545/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:26.067552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e894-cef7-460b-8c86-308d133dba40 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.096012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.168883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e894-cef7-460b-8c86-308d133dba40 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.200616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.201406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.201706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.201981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.203183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.204564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1036f1-591d-4337-a320-71c4a6849d7b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.206263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 564/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:26.212563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.222779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.309511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306d1c-127b-440d-a6f6-fc3caf0274b4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.344953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.345650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.345936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.346216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.346931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.348354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c3b19-1821-43da-8d77-7d879bbef9fd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.368089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 546/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:26 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:28.434625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219357c7-ecf1-45d4-91c9-63229b1ce820 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.435165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219357c7-ecf1-45d4-91c9-63229b1ce820 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.435165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219357c7-ecf1-45d4-91c9-63229b1ce820 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.436519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 565/1111] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:28.441621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.442019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.442189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.459145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:28.460325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.517584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.529064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 547/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:28.553398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219357c7-ecf1-45d4-91c9-63229b1ce820 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.645094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.652999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219357c7-ecf1-45d4-91c9-63229b1ce820 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.684641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.685512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.685790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.686062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] PATH_INFO: `/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.687505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] RBAC: Authorizing `identity:get_role(role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.688863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.690221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 566/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:28.696527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.792029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834fe5-83ce-4398-aba1-1659acf2478a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.825675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.826520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.826794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.827060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] PATH_INFO: `/v3/users/7b81f8594ab142e4b4cef41af270ff27` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.841512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=7b81f8594ab142e4b4cef41af270ff27)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.842947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.844607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 548/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/users/7b81f8594ab142e4b4cef41af270ff27 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:28.851447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.951006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61b6ab-dd20-4541-ae75-d09d1d4a1ab4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.983481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.984112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.984394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.984671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.016366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.053668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.055117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.152536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 567/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:29.158405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.209844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.255639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c47cb-9064-4141-b382-e542e09dd5a3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.288860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.289719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.290006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.290279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.291431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.292842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d89b-a2b2-4b34-9be5-be9bb8ed83b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.294545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 549/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:29.300533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.359836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.396653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccdd8-bda0-43e5-95cd-ebc34719a55e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.429962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.430608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.430889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.431162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.431974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=fc06233e42014e669193ea872656b173, user.id=7b81f8594ab142e4b4cef41af270ff27) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:29.432287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.433738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbbf7f-bdb2-4a9c-be85-373980817c0d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.438939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 568/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/role_assignments?user.id=7b81f8594ab142e4b4cef41af270ff27&scope.project.id=fc06233e42014e669193ea872656b173&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:31.443200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48bc1-3b55-4d5c-b7f1-f902d987afc8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:31.443730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48bc1-3b55-4d5c-b7f1-f902d987afc8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:31.443730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48bc1-3b55-4d5c-b7f1-f902d987afc8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:31.445102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 550/1118] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:31.450325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:31.450713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:31.450883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:31.467815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:31.469003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:31.535130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 569/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:31.558641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48bc1-3b55-4d5c-b7f1-f902d987afc8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:31.658335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48bc1-3b55-4d5c-b7f1-f902d987afc8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:31.677422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:31.691100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536694-6637-468e-9802-a478a6de221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:31.691938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536694-6637-468e-9802-a478a6de221b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:31.692760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536694-6637-468e-9802-a478a6de221b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:31.693285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536694-6637-468e-9802-a478a6de221b None admin] PATH_INFO: `/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:31.694694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536694-6637-468e-9802-a478a6de221b None admin] RBAC: Authorizing `identity:get_role(role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:31.696061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536694-6637-468e-9802-a478a6de221b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:31.697436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 551/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:31 2022] GET /identity/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:31.703311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:31.758689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:31.798739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f100-5ac6-407c-babc-bce82b9562fb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:31.831268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:31.832120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:31.832398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:31.832668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] PATH_INFO: `/v3/users/7b81f8594ab142e4b4cef41af270ff27` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:31.833923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] RBAC: Authorizing `identity:get_user(user_id=7b81f8594ab142e4b4cef41af270ff27)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:31.835351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:31.836952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 570/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:31 2022] GET /identity/v3/users/7b81f8594ab142e4b4cef41af270ff27 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:31.842744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536694-6637-468e-9802-a478a6de221b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:31.939941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536694-6637-468e-9802-a478a6de221b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:31.972451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:31.973292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:31.974220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:31.974503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:31.975685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:31.977112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4602-0120-4a96-a350-52ea794642fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:31.978831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 552/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:31 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:31.984796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.082682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556e03-467c-4cbd-b0d7-c6943d0f0c6c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.108897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.118080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.118955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.119239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.119516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173/users/7b81f8594ab142e4b4cef41af270ff27/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.121725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] RBAC: Authorizing `identity:create_grant(project_id=fc06233e42014e669193ea872656b173, user_id=7b81f8594ab142e4b4cef41af270ff27, role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:32.123160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87205cb-990f-40ee-86c1-9529d5a8a63b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:32.135672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 571/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:31 2022] PUT /identity/v3/projects/fc06233e42014e669193ea872656b173/users/7b81f8594ab142e4b4cef41af270ff27/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:34.122746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c4a9-ca6f-4758-849a-564726ea5a8e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.123273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c4a9-ca6f-4758-849a-564726ea5a8e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.123273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61c4a9-ca6f-4758-849a-564726ea5a8e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.124658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 553/1124] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:34.130514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.130913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.131060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.147242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:34.148658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:34.212763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 572/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:34.236192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61c4a9-ca6f-4758-849a-564726ea5a8e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.297777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.343718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61c4a9-ca6f-4758-849a-564726ea5a8e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.377249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.378055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.378338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.378614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] PATH_INFO: `/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.381139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] RBAC: Authorizing `identity:get_role(role_id=0ade323f4cc94fe4be9957fcd82fd9ed)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.382551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.383923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 554/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/roles/0ade323f4cc94fe4be9957fcd82fd9ed => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.389789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.484407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7e034-ad1f-491d-a825-340d1446f4ff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.500754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.519118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.519960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.520233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.520532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] PATH_INFO: `/v3/users/7b81f8594ab142e4b4cef41af270ff27` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.521867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] RBAC: Authorizing `identity:get_user(user_id=7b81f8594ab142e4b4cef41af270ff27)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.523562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.525145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 573/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/users/7b81f8594ab142e4b4cef41af270ff27 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.530832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.627927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5819967-efd4-49c5-a841-49a0ec6f52fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.650613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.661792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.662580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.662864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.663138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.728202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.729658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.828270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 555/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:34.835359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.933456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249de3-f1f7-402f-9bb2-4b48dc0d1461 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.966394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.967235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.967519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.967799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] PATH_INFO: `/v3/projects/fc06233e42014e669193ea872656b173` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.968975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] RBAC: Authorizing `identity:get_project(project_id=fc06233e42014e669193ea872656b173)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.970437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2ec1d-3f77-490e-80e8-54a70d344681 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.972091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 574/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/projects/fc06233e42014e669193ea872656b173 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.978239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:35.002174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:35.074717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aaa86-5908-4402-b384-70a17af6b3cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.106409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.107037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.107315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.107589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.108405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] RBAC: Adding query filter params (role.id=0ade323f4cc94fe4be9957fcd82fd9ed, scope.project.id=fc06233e42014e669193ea872656b173, user.id=7b81f8594ab142e4b4cef41af270ff27) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:35.108712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.110158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c553e-8424-4216-8075-168b495723ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.116324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 556/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/role_assignments?user.id=7b81f8594ab142e4b4cef41af270ff27&scope.project.id=fc06233e42014e669193ea872656b173&role.id=0ade323f4cc94fe4be9957fcd82fd9ed => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.166709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0719-5a5a-4cc4-8cad-50deb1d7c385 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.167285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0719-5a5a-4cc4-8cad-50deb1d7c385 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.167285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0719-5a5a-4cc4-8cad-50deb1d7c385 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.168596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 575/1131] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:37.173824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.174263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.174362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.191272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:37.192873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:37.258811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 557/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:37.283084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0719-5a5a-4cc4-8cad-50deb1d7c385 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.336913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.388506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0719-5a5a-4cc4-8cad-50deb1d7c385 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.422770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.423480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.423761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.424038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.425214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.426730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df942a4-b50d-431f-a21b-6fbffde694ba None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.428332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 576/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.434445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.452278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.530692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425367a-811c-407a-bf9b-97a0a9af1fb4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.562498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.563136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.563415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.563688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.564395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.565847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7705f4-c7e2-4de2-976b-92c9cfe2e860 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.590444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 558/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:37 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:39.649748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b693c-0375-45c0-a314-6fd121292b0a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.650288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b693c-0375-45c0-a314-6fd121292b0a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.650384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b693c-0375-45c0-a314-6fd121292b0a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.651671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 577/1135] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:39.656693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.657124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.657227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.673620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:39.674794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:39.734518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.740496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 559/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:39.765268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b693c-0375-45c0-a314-6fd121292b0a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.864551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b693c-0375-45c0-a314-6fd121292b0a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.883765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.897237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.898282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.898563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.898837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.900034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.901444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c85a-56cd-4ff7-be55-d15ec5fcc7e0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.903037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 578/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.908740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.005243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22a113-4f8c-47ea-84e7-99e80d1aeb8b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.039017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.039667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.039946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.040218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.040911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.042353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dd7a0-8523-4951-9492-45d1c3b2af38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.064418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 560/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:39 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:42.123754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644305f5-791e-4953-9597-6464ff7093a2 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.124322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644305f5-791e-4953-9597-6464ff7093a2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.124322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644305f5-791e-4953-9597-6464ff7093a2 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.125677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 579/1139] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:42.131398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.131812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.131960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.149103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:42.150302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:42.198160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.217535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 561/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:42.241511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644305f5-791e-4953-9597-6464ff7093a2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.341424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644305f5-791e-4953-9597-6464ff7093a2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.374436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.375148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.375434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.375715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.386068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:42.393634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:42.394885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:42.396108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 580/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:42.401272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.498849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4857a-c368-4a60-988b-ed41b6062f91 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.533243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.533934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.534220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.534498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.535244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:42.535551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:42.537145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:42.545212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 562/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:42.550931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.603520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.653525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e810f-668a-4733-9fc6-6bcde20f5795 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.686002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.686847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.687125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.687398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] PATH_INFO: `/v3/users/361e287c93644bd588b99f2be7e101d0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.700012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] RBAC: Authorizing `identity:get_user(user_id=361e287c93644bd588b99f2be7e101d0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:42.701486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:42.703097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 581/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/users/361e287c93644bd588b99f2be7e101d0 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:42.709403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.757623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.806253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9893-6884-4932-80fe-522be2b2f40e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.838801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.839434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.839712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.839985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.904327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:42.905726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:42.951485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.001059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 563/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:43.007003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.101422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c7f89-fcf8-48c6-89e7-50bc2a74eaad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.108329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.134597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.135427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.135707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.135976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] PATH_INFO: `/v3/projects/411caa1106f5445bb545b95248f6c725` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.137119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] RBAC: Authorizing `identity:get_project(project_id=411caa1106f5445bb545b95248f6c725)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.138568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd15c41-906a-4de2-aec3-86b0b6e18b39 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.140208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 582/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/projects/411caa1106f5445bb545b95248f6c725 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:43.146747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.242205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad8c6f-e31b-4b56-a255-4d193521cd91 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.275375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.276006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.276284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.276557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.277397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=411caa1106f5445bb545b95248f6c725, user.id=361e287c93644bd588b99f2be7e101d0) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:43.277715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.279121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385855a8-0ef7-44e5-acd1-5da70df3cb7b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.284359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 564/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/role_assignments?user.id=361e287c93644bd588b99f2be7e101d0&scope.project.id=411caa1106f5445bb545b95248f6c725&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:45.284393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ee79-b52e-4ebd-bd53-483e8b5b0ca1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.284915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ee79-b52e-4ebd-bd53-483e8b5b0ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.284915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ee79-b52e-4ebd-bd53-483e8b5b0ca1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.286988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 583/1147] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:45.292217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.292589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.292774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.310993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:45.312180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:45.320198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.379338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 565/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:45.402451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ee79-b52e-4ebd-bd53-483e8b5b0ca1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.499329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ee79-b52e-4ebd-bd53-483e8b5b0ca1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.532291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.533057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.533338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.533641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.544251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:45.552620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:45.553717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:45.554580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 584/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:45.560043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.657594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42289f3c-a2d5-4f68-9c3b-428ddcf7ca80 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.695714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.696369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.696645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.696916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.697687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:45.697993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.699343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.707058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 566/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:45.712884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.746701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.811080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1b8c-b49f-414e-95b4-ee654f2dc66f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.842315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.843157 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.843437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.843707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] PATH_INFO: `/v3/users/361e287c93644bd588b99f2be7e101d0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.844867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] RBAC: Authorizing `identity:get_user(user_id=361e287c93644bd588b99f2be7e101d0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.846310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.847880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 585/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/users/361e287c93644bd588b99f2be7e101d0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:45.854271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.858032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.955155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01089-5878-4ee2-ad96-60c7e940f63c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.987640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.988487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.989419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.989706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] PATH_INFO: `/v3/projects/411caa1106f5445bb545b95248f6c725` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.991002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] RBAC: Authorizing `identity:get_project(project_id=411caa1106f5445bb545b95248f6c725)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.992433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf55c9-c8cc-4576-b2bd-3347d3813d23 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.994143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 567/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/projects/411caa1106f5445bb545b95248f6c725 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.000036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.096654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100fb6-dfe1-43c0-aacb-c415d2fea8cf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.098090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.130806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.131667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.131950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.132228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] PATH_INFO: `/v3/projects/411caa1106f5445bb545b95248f6c725/users/361e287c93644bd588b99f2be7e101d0/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.134184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] RBAC: Authorizing `identity:create_grant(project_id=411caa1106f5445bb545b95248f6c725, user_id=361e287c93644bd588b99f2be7e101d0, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.135610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1d05-7e83-4548-8742-256be3500358 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.149290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 586/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:45 2022] PUT /identity/v3/projects/411caa1106f5445bb545b95248f6c725/users/361e287c93644bd588b99f2be7e101d0/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:48.241157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456637-c862-4473-ae9c-d21fb30ad45b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.241768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456637-c862-4473-ae9c-d21fb30ad45b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.241768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456637-c862-4473-ae9c-d21fb30ad45b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.243086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 568/1154] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:48.248159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.248564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.248715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.266189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:48.267373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:48.334734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 587/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:48.358007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456637-c862-4473-ae9c-d21fb30ad45b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.427864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.459029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456637-c862-4473-ae9c-d21fb30ad45b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.491261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.491966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.492247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.492522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.502133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:48.510519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:48.511596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 05:59:48.512746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 569/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:48.517618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.607315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.617082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255c2b-b4f2-4672-97e2-8faa1af2accf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.650924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.651580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.651862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.652138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.652873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:48.653176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.654585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.662823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 588/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:48.668549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.766538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5139de-390f-43e0-920c-571ff817fa1c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.794929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.800319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.801760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.802184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.802465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] PATH_INFO: `/v3/users/361e287c93644bd588b99f2be7e101d0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.803654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] RBAC: Authorizing `identity:get_user(user_id=361e287c93644bd588b99f2be7e101d0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.805086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.806735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 570/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/users/361e287c93644bd588b99f2be7e101d0 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.812488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.912231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e05ab-ed9f-45f9-bfce-8134cb8cda13 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.958733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.959371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.959652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.959926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.984488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.027526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.028906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.124301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 589/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:49.130378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.227612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e34f-1794-4036-9f24-9c65d30af2ba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.258921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.259761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.260495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.260774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] PATH_INFO: `/v3/projects/411caa1106f5445bb545b95248f6c725` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.262630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=411caa1106f5445bb545b95248f6c725)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.264065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ad2ec-5e4b-4464-8809-7592c986b0f3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.265779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 571/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/projects/411caa1106f5445bb545b95248f6c725 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:49.272757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.325816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.369578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce279e-7894-46d5-b76c-e77a890e4c2e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.402336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.402974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.403258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.403537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.404347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=411caa1106f5445bb545b95248f6c725, user.id=361e287c93644bd588b99f2be7e101d0) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:49.404660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.406124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe75914-141d-4856-a9dc-b0ddb7774a60 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.412581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 590/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/role_assignments?user.id=361e287c93644bd588b99f2be7e101d0&scope.project.id=411caa1106f5445bb545b95248f6c725&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.434217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274dce6-d0c0-4599-84ee-884eef40d4a4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.434712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274dce6-d0c0-4599-84ee-884eef40d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.434801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274dce6-d0c0-4599-84ee-884eef40d4a4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.436135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 572/1162] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:51.441239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.441675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.442262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.458791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:51.459978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:51.524837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 591/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:51.547389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274dce6-d0c0-4599-84ee-884eef40d4a4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.612608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.646243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274dce6-d0c0-4599-84ee-884eef40d4a4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.678852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.679478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.679757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.680031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.743906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.745334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.806989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.840024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 573/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:51.846044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.892638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.941563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938958-5007-4c4f-a682-678110eba6aa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.976926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.978858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.979158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.979441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.986439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.987892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4f3f3f34-2be7-4329-b642-f1b5b303a7aa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:52.001821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:52.003013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 05:59:52.003857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 592/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:52.009622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.106571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713aa31-3731-4baf-8b9c-f352341ea789 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.140359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.141002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.141285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.141586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.142296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:52.142600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.143994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a68f7-da5f-4646-a7d3-11b8f26a950b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.151365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 574/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:54.151604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb55c-2da3-4e01-8837-89fa956ddbca None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.152129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb55c-2da3-4e01-8837-89fa956ddbca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.152129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb55c-2da3-4e01-8837-89fa956ddbca None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.153526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 593/1167] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:54.158640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b6c9-4e54-4bb3-91c4-7e01d4d3e74d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.159009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b6c9-4e54-4bb3-91c4-7e01d4d3e74d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.159199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b6c9-4e54-4bb3-91c4-7e01d4d3e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.175935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3d30b6c9-4e54-4bb3-91c4-7e01d4d3e74d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:54.177634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3d30b6c9-4e54-4bb3-91c4-7e01d4d3e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:54.202191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.243840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 575/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:54.267126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb55c-2da3-4e01-8837-89fa956ddbca None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.367086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb55c-2da3-4e01-8837-89fa956ddbca None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.375817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.400593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.401245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.401561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.401889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.402589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.403961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946454b-1635-4f9f-aa70-2ff54f9d2bdb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.418722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 594/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Jun 20 05:59:54 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:56.459190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123814c6-502b-4202-bce7-ac970e714a7a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.459697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123814c6-502b-4202-bce7-ac970e714a7a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.459808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123814c6-502b-4202-bce7-ac970e714a7a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.461107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 576/1170] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:56.466303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.466715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.466858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.483690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:56.484860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:56.548958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 595/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:56.572676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123814c6-502b-4202-bce7-ac970e714a7a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.671408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123814c6-502b-4202-bce7-ac970e714a7a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.704897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.705756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.706032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.706303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] PATH_INFO: `/v3/domains/6bf7ae75441443339a483fcfb8831bd5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.717151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bf7ae75441443339a483fcfb8831bd5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.718628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff3c77-8847-48ec-92f1-b4b647a327f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.720261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 577/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/domains/6bf7ae75441443339a483fcfb8831bd5 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:56.726383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.820909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:56.824734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d26e5-a955-429d-8b53-305afc815aea None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.858421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.859059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.859338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.859609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.860313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.861779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402e1e-88de-4e5e-94fc-0b0776ee2f2f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.887255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 596/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:56 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:58.938896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998202-be0e-41d1-9355-d8cc1572766b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.939451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998202-be0e-41d1-9355-d8cc1572766b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.939451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998202-be0e-41d1-9355-d8cc1572766b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.940788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 578/1174] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:58.946119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.946529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.946679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.963675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:58.964846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:59.029213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 597/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:59.054051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998202-be0e-41d1-9355-d8cc1572766b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.078394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.153244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998202-be0e-41d1-9355-d8cc1572766b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.185836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143f148-364d-4481-bcae-16073290306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.186670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f148-364d-4481-bcae-16073290306a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.186943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f148-364d-4481-bcae-16073290306a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.187211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f148-364d-4481-bcae-16073290306a None admin] PATH_INFO: `/v3/domains/6bf7ae75441443339a483fcfb8831bd5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.188364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143f148-364d-4481-bcae-16073290306a None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bf7ae75441443339a483fcfb8831bd5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.189866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143f148-364d-4481-bcae-16073290306a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.191413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 579/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/domains/6bf7ae75441443339a483fcfb8831bd5 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:59.197609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.276215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.296184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364fd4-baca-4ccd-917c-279d5545dc97 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.329794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.329917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.330151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.330424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.331136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.332571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257e2aa-9260-41b1-b509-a6431275319b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.352256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 598/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:59 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:01.402777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12356d4-44f8-4432-9366-579b1bef38c0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.403290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12356d4-44f8-4432-9366-579b1bef38c0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.403390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12356d4-44f8-4432-9366-579b1bef38c0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.404697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 580/1178] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:01.409958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.410962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.411203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.427540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:01.428713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:01.493616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 599/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:01.517260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12356d4-44f8-4432-9366-579b1bef38c0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.606554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.617324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12356d4-44f8-4432-9366-579b1bef38c0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.651072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.651837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.652116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.652390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.662172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:01.669678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:01.670843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:00:01.671966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 581/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:01.676787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.738890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.774255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae830d-b6c0-4e67-937d-eb8767a49b77 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.806811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.807463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.807742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.808014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.808746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:01.809049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.810448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.818612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 600/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:01.824317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.921152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4809b9-30e1-468d-989e-40a38c4b8e5d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.953511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.954355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.954631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.954903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] PATH_INFO: `/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.967429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] RBAC: Authorizing `identity:get_user(user_id=e2b5cd35bfe3490b9c4ca6ddc4debfc5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.968851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.970489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 582/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.976415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.076884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee29dc-4607-4cc0-baae-7fd72857fcfb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.101704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:02.109751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.110392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.110674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.110951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.175542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.177677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.272139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 601/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:00:02.278273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.289488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:02.379954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6b41-f20a-415d-9181-656ea61523be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.413686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.414540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.414822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.415100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] PATH_INFO: `/v3/projects/85182c79816945c1a8c716eb2f1a9882` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.416265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=85182c79816945c1a8c716eb2f1a9882)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.417722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a723d2-5da9-4b2b-bcdc-abb7e8c90ac2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.419414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 583/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/projects/85182c79816945c1a8c716eb2f1a9882 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:02.425462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.452236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:02.520380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cb0a-d91b-4554-acc8-6a05f161925f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.553738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.554376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.554657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.554934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.555742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=85182c79816945c1a8c716eb2f1a9882, user.id=e2b5cd35bfe3490b9c4ca6ddc4debfc5) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:02.556050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.557500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fce8d-aeee-4fb2-b77b-e2c0f05e1637 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.562706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 602/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/role_assignments?user.id=e2b5cd35bfe3490b9c4ca6ddc4debfc5&scope.project.id=85182c79816945c1a8c716eb2f1a9882&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:04.552042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23f40-d023-45be-b888-ad896a92d3f3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.552590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23f40-d023-45be-b888-ad896a92d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.552590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23f40-d023-45be-b888-ad896a92d3f3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.553984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 584/1186] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:04.559182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.559611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.559761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.576632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:04.577861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:04.641901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 603/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:04.665263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23f40-d023-45be-b888-ad896a92d3f3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.742270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.765858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23f40-d023-45be-b888-ad896a92d3f3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.799524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.800296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.800575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.800844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.810578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:04.818700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:04.819776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:00:04.820660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 585/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:04.825909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.849425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.923755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58bf85-8e20-40b2-b34b-dc68148c60de None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.956706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.957512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.957793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.958062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.958790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:04.959092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.960459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.968141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 604/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:04.974370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.071407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c10c-834d-4210-b0f7-641fb9d091ba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.103905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.104744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.105024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.105298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] PATH_INFO: `/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.106488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b5cd35bfe3490b9c4ca6ddc4debfc5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.107914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.109532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 586/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:05.115742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.195908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:05.211247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130aec-288a-400c-a14c-6fd97694dd6b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.243203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.244034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.244310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.244579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] PATH_INFO: `/v3/projects/85182c79816945c1a8c716eb2f1a9882` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.245745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] RBAC: Authorizing `identity:get_project(project_id=85182c79816945c1a8c716eb2f1a9882)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.247180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020270f-f70b-4c7b-8e35-5c0b58682304 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.248853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 605/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:05 2022] GET /identity/v3/projects/85182c79816945c1a8c716eb2f1a9882 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:05.255227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.258982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:05.353047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495c17-ae38-41df-acd4-f695a3f5ee37 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.385115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.386012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.386291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.386562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] PATH_INFO: `/v3/projects/85182c79816945c1a8c716eb2f1a9882/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.388491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] RBAC: Authorizing `identity:create_grant(project_id=85182c79816945c1a8c716eb2f1a9882, user_id=e2b5cd35bfe3490b9c4ca6ddc4debfc5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.389946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db0f9-fdc7-4da1-b62f-2f1beb923207 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.402380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 587/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:05 2022] PUT /identity/v3/projects/85182c79816945c1a8c716eb2f1a9882/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:07.406949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f5d1-0bd0-46d9-bed4-6e713c81b24c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.407427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f5d1-0bd0-46d9-bed4-6e713c81b24c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.407518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f5d1-0bd0-46d9-bed4-6e713c81b24c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.408861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 606/1193] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:07.414185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.414604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.414751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.431672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:07.432859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:07.489917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.498751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 588/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:07.523647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f5d1-0bd0-46d9-bed4-6e713c81b24c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.622449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f5d1-0bd0-46d9-bed4-6e713c81b24c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.654154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.654919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.655200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.655477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.666186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:07.673729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:07.674790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:00:07.676464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 607/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:07.681323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.776790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f7dcd-c270-4ff6-8899-a900b8fe7014 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.810207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.810859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.811143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.811421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.812163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:07.812472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:07.813873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:07.821715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 589/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:07.827256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.841722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.925214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bad00-d180-43ff-a340-5279fdc59c3c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.958520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.959370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.959654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.959930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] PATH_INFO: `/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.961104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] RBAC: Authorizing `identity:get_user(user_id=e2b5cd35bfe3490b9c4ca6ddc4debfc5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:07.962559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:07.964153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 608/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/users/e2b5cd35bfe3490b9c4ca6ddc4debfc5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:07.969887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.024563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.069102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dacd6-a6b5-47ee-8e52-ad5eccdf5691 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.101936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.102570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.102851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.103125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.167279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.168708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.220917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.264006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 590/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:00:08.269921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.349168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.368034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414bdf-a7ba-425f-8408-0e417cc0b0aa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.401602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.402449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.402730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.403008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] PATH_INFO: `/v3/projects/85182c79816945c1a8c716eb2f1a9882` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.404184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] RBAC: Authorizing `identity:get_project(project_id=85182c79816945c1a8c716eb2f1a9882)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.405698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62eb3f-2fee-445c-84a3-a506e19ebe2b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.407374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 609/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/projects/85182c79816945c1a8c716eb2f1a9882 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.413570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.508072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9849ac-5576-48f2-ae9b-e0fab5b247bb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.540736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.541364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.541672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.541944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.542753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=85182c79816945c1a8c716eb2f1a9882, user.id=e2b5cd35bfe3490b9c4ca6ddc4debfc5) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:08.543057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.544453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06f8a-7839-4889-88f1-7dcbe489bdd6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.550063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 591/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/role_assignments?user.id=e2b5cd35bfe3490b9c4ca6ddc4debfc5&scope.project.id=85182c79816945c1a8c716eb2f1a9882&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:18.397223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=26 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.547482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.352588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ada24-cf32-4778-b0b3-d7a07e4d2bc4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.352588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ada24-cf32-4778-b0b3-d7a07e4d2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.352588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ada24-cf32-4778-b0b3-d7a07e4d2bc4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.352588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 610/1201] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:04.360171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.360171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.360171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.378844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:04.380370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:04.461213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 592/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:04.489304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ada24-cf32-4778-b0b3-d7a07e4d2bc4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.619300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ada24-cf32-4778-b0b3-d7a07e4d2bc4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.664518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.665721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.666227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.666720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.678678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.680131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:04.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:04.702991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:04.704465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:04.704465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:04.704465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:04.704465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:04.704465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 611/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:04.709361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.836744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78b8f-0f11-4bb0-a99e-5159f0c7f3e7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.872782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.880433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.881094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.881433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.881690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.882423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.882732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.884103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bafb3-62e9-408d-b29c-08ba755fab88 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.896643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 593/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.902910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.970671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.029953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ef12f-382d-41b0-aebd-08ad11bfedde None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.069691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.070463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.070728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.071056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.071722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.073181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2fe2e-dd05-4525-a0e3-8a7dcc4fc5f0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.105415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 612/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jun 20 06:01:04 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:07.646531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6d5c-43b9-4a98-8495-4c360e8b5322 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.647087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6d5c-43b9-4a98-8495-4c360e8b5322 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.647444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6d5c-43b9-4a98-8495-4c360e8b5322 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.649744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 594/1206] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:07.656318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.656735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.656957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.677074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:07.678345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:07.763077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 613/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:07.791390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e6d5c-43b9-4a98-8495-4c360e8b5322 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:07.913852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e6d5c-43b9-4a98-8495-4c360e8b5322 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:07.956507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:07.957310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.957609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.957897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.968917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:07.977874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:07.978902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:07.979774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 595/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:07.985215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.030420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.103708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744ab83-73fb-496b-b407-2771f32bd4d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.143357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.144382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.144827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.145258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.146171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:08.146706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.148384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.157993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 614/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:08.164277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.222517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.285912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ceda0-f669-4f13-bc88-646c98d1db72 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.334656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.335721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.336063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.336426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.354752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.356338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:08.378333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:08.379745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:08.380795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:08.380795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:08.380795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:08.380795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:08.380795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 596/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:08.385568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.496137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.499300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3876-f4a6-4a82-ab5d-1892e89e7571 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.537903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.538518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.538805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.539087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.539815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:08.540136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.541551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.555946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 615/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:08.562032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.680415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a78d4-4082-4698-b1fb-5e9a9a3c6f99 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.683500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.725226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.726179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.726536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.726934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.734741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.736315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:08.751692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:08.753495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:08.754636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:08.756648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 597/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:08.762478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.871701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08dbb-8644-4a0b-9b05-2dbb96468b71 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.914460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.915154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.915465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.915755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.916604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:08.916913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.918491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.937863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 616/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:08.943968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.057676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645ff5-3eb7-45e9-bd49-3cd2e3d9d1bf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.097616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.098280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.098567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.098829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.132715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.179300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.180672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.305504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 598/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:09.307161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.335211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.431522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a92d-8680-4789-801e-e59c36119286 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.469400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.470233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.471087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.471465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.482974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.484597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:09.505562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:09.506550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:09.507472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:09.507472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:09.507472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:09.507472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:09.507472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 617/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:09.512708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.581503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.628933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca098b-2c34-4d6f-99b0-f0f82b45d9da None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.669287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.669980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.670260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.670532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.671381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.671810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.673199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.686430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 599/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:09.693351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.786231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.824603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61856feb-b052-47ae-8fba-9276650e5188 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.880405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.882044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.882587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.883229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.896888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.899840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:09.926998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:09.928035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:09.928996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:09.938800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.940013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 618/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:10.055879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314ea93-fe19-41ae-b2cc-e872594ea16c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.083101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.098992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.099663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.099946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.100223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.101014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.101314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.102795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcbc4b-5891-441f-9adf-555900984404 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.116953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 600/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:10.123055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.254099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f851c-a7be-439c-afce-7c045c557330 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.286758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.293799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.294411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.294694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.294978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.295813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=94a2e4c690694f1b8cf0ced06d7715ba) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.296128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.297606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44cee-b6e6-4f63-89e1-4b62fc553f26 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.304421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 619/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/role_assignments?user.id=94a2e4c690694f1b8cf0ced06d7715ba&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:12.439801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae483-fae9-4032-bc14-0135b725f02c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.440562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae483-fae9-4032-bc14-0135b725f02c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.440689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae483-fae9-4032-bc14-0135b725f02c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.442454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 601/1220] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:12.447946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.448462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.448746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.467802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:12.469107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:12.542628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 620/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:12.566789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae483-fae9-4032-bc14-0135b725f02c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.677943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae483-fae9-4032-bc14-0135b725f02c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.714980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.715772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.716049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.716369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.726741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:12.734700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:12.735855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:12.737595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 602/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:12.742664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.854983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd391c-6e6c-4a8f-a4d1-daa07d9bfd2c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.880060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.890733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.891404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.891686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.891956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.893324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:12.893661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.895053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.903322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 621/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:12.909478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.954700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.019906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355c4ac-f85b-4c58-8460-79d901bf69b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.057190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.058020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.058309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.058577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.069700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.071181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:13.094886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.096073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.097056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:13.097056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:13.097056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.097056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:13.097407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 603/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:13.105150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.212872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1292-15e0-4a50-9dba-401b785f7493 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.254457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.255120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.255469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.255744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.256597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.256897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.258406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.270669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 622/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:13.276800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.385631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.394101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ee87-ea78-452c-a6bb-42b5b7d15bc7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.434000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.434877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.435161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.435440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.445440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.447105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:13.463399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.464469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:13.471405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 604/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:13.472120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.525491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.583942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e0a7f-0522-4a53-9a26-4611050bb6fd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.620433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.621100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.621473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.621749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.622611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.622914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.624411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.643030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 623/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.649062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.763392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822af41d-1a36-4f8b-8fe8-91af5f9e8425 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.801698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.802522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.802799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.803079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.814769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.816446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:13.833966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.835074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.836010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:13.836010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:13.836010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.836010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:13.836010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 605/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:13.841368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.947436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a632f0d-5d61-4be0-a70a-82c2ac43fcb2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.950078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.987722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.988395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.988681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.988951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.989704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.990013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.991398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.003839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 624/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:14.010161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.020291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.122446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2801-2e44-4006-8ce7-99ab469d7291 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.161871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.162669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.162951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.163243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.170141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.171628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:14.186743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:14.187700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:14.193982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 606/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:14.194481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.307852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5065a8-73eb-4086-88ce-db54ad87b465 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.351716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.352376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.352660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.352937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.353755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.354064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.355500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1023b-1fda-4017-9fe2-f2f491f16bb5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.369359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 625/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:14.375332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.455638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.495599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d57-41bd-4bfb-9758-60c31b6f4759 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.532682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.534342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.534625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.534933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/94a2e4c690694f1b8cf0ced06d7715ba/roles/49c9cad79a3146168f4fab0f41eb29f9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.551053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=94a2e4c690694f1b8cf0ced06d7715ba, role_id=49c9cad79a3146168f4fab0f41eb29f9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.552488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63073ef3-73d0-48e8-80f3-b1ab86268e83 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.565916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 607/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:14 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/94a2e4c690694f1b8cf0ced06d7715ba/roles/49c9cad79a3146168f4fab0f41eb29f9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:16.630035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebcb35-4f07-45d6-b13c-6fb45313c9d6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.630563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebcb35-4f07-45d6-b13c-6fb45313c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.630666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebcb35-4f07-45d6-b13c-6fb45313c9d6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.632110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 626/1233] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:16.637270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.637816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.637907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.655891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:16.657066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:16.729688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 608/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:16.754199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebcb35-4f07-45d6-b13c-6fb45313c9d6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:16.780623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:16.877510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebcb35-4f07-45d6-b13c-6fb45313c9d6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:16.914912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:16.915749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.916094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.916390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.927167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:16.935514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:16.936798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:16.937702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 627/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:16.943262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:16.995199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.055916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44781ff4-df05-4e71-b29c-37ff72b6db7c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.098494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.099176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.099516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.099791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.100566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:17.100876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.102593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.113125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 609/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:17.119047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.215523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.235008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b66e49-6e2a-4921-a39d-af94a7fceac1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.273684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.274476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.274755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.275029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.286237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.287686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:17.305001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:17.306279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:17.307180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:17.307180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:17.307180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:17.307180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:17.307180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 628/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:17.312319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.432268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7554e-5023-4b46-bb02-cecdc9a0a4f9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.442149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.470894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.471894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.472533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.473116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.474083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:17.474665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.476683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.491577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 610/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:17.497571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.609593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfe114-5ac7-49ee-a032-1215a2fa5533 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.645037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.645861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.646146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.646415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.649501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.654668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.656299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:17.671403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:17.672598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:17.673821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 629/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:17.679116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.796931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c7a67-3d70-4448-8a87-544151a2b267 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.834139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.835027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.835387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.835747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.836713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:17.837119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.838686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.858433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 611/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:17.865145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.988775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367706-23a3-43b7-8085-146e61b9487b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.026703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.027560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.027914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.028310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.100385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.108623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.110588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.227367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 630/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:18.233613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.267841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.350887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9f6f-89b1-4851-b71e-d3259015a3f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.391358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.392234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.392518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.392797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.404412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.406029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:18.425363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.426698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.427599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:18.427599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:18.427599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.427599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:18.427599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 612/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.434840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.537716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.544886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e981e6-8d38-4e9e-8b29-661c5c95dc63 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.583345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.584004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.584288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.584564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.585277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.585620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.586998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.598366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 631/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:18.604570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.687754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.714450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e399-4184-44a7-8992-7be72395da38 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.752741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.753699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.754009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.754287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.761576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.763021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:18.777026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.778154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:18.779217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 613/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.784931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.894863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba6c7-1a34-4781-8091-664f23c2e830 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.931228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.931887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.932170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.932444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.933227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.933567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.935001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca55f-88a6-468b-b23f-84655b496737 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.947280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 632/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.953858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.066193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f625e8-41ba-446b-a0ac-047c409f6611 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.106750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.107517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.107956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.108400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.109434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] RBAC: Adding query filter params (role.id=49c9cad79a3146168f4fab0f41eb29f9, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=94a2e4c690694f1b8cf0ced06d7715ba) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.109820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.112430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d182-ba96-424e-8d39-231f9014bd82 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.120040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 614/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/role_assignments?user.id=94a2e4c690694f1b8cf0ced06d7715ba&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=49c9cad79a3146168f4fab0f41eb29f9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:21.291491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f0a7-862f-4f5e-bff2-2950e33c1f7c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.292066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f0a7-862f-4f5e-bff2-2950e33c1f7c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.292183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f0a7-862f-4f5e-bff2-2950e33c1f7c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.293699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 633/1247] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:21.300288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.300699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.300838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.307037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:21.320942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:21.322197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:21.412533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 615/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:21.441923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f0a7-862f-4f5e-bff2-2950e33c1f7c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:21.463110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:21.554153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f0a7-862f-4f5e-bff2-2950e33c1f7c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:21.593701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:21.594495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.594776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.595093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.607111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:21.615921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:21.617072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:21.618080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 634/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:21.623629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:21.746138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e2ef6-7589-4556-905b-fb579e344eab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:21.781663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:21.787576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:21.788278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.788571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.788844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.789665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:21.789973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:21.791335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:21.800798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 616/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:21.809622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:21.903088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:21.928603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808841-e57e-41be-a55c-3cac06fc999e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:21.971946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:21.973018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.973342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.973657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.987987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:21.989497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:22.008792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.009977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.010862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:22.010862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:22.010862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:22.010862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:22.010862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 635/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.016168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.139687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cace8-8890-4069-b9b7-563d11f4f72a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.176725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.177442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.177732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.178012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.178749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.179085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.180429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.193800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 617/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:22.199907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.310115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc5e8-aa51-4d55-bf16-f1d9ed5cd008 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.339965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.349451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.350252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.350537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.350823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.360205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.362357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:22.381602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.382799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:22.385440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 636/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.388854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.449550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.499323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e3fae-89fb-4068-a231-f322177b1b3a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.540263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.540929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.541333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.541668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.542751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.543152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.544810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.565509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 618/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:22.571929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.691611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850695a-ac88-4d34-96ff-50b05f124d28 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.736760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.737352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.737681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.737968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.805520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.819520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.820993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.933327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 637/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:22.939886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.044294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d7d4-2858-4727-9c90-2e19916fbaa8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.061935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.088983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.089831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.090114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.090387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.102509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.104380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:23.125194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:23.127262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:23.128323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:23.128323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:23.128323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:23.128323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:23.128323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 619/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:23.135335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.240498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.253694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a90a4-8e70-4ac3-a58b-a89f9b224fe2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.289130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.289823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.290107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.290384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.291113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.291392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.292785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.305411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 638/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:23.311087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.424998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c734-2a5c-4d7c-be38-52b5f529fed4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.461849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.462650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.462939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.463226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.471053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.472538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:23.487206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:23.488442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:23.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 620/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:23.494270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.613720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c2a7-1cd8-4dca-80d7-419762a7f5b3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.663411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.664489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.664986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.665508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.666949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.667458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.670088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba741fe-33a4-4f7a-9ad2-d3c24ebdfc57 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.689991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 639/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:23.698078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.734856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.816303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527216de-1574-47bf-95dd-a8970f980204 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.853253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.854533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.854533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.854707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.855408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=94a2e4c690694f1b8cf0ced06d7715ba) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.855721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.857186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848562-f7d9-48e6-a91b-0443061ad993 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.864130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 621/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/role_assignments?user.id=94a2e4c690694f1b8cf0ced06d7715ba&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:25.908987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6763a-d15f-453e-b147-830970dd6a88 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.909603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6763a-d15f-453e-b147-830970dd6a88 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.909603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6763a-d15f-453e-b147-830970dd6a88 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.910926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 640/1261] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:25.916034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.916418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.916578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.933464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:25.934626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:25.998008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 622/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:26.020517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6763a-d15f-453e-b147-830970dd6a88 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.031576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.136272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6763a-d15f-453e-b147-830970dd6a88 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.172715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.174122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.174405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.174681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.184506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:26.192917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:26.194025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:26.200072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 641/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:26.200777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.218784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.296940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235dec-bdea-4c68-80f0-91c6fab0dfaf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.330605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.331220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.331497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.331770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.332509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:26.332813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.334201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.342089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 623/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:26.347739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.415504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.448368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d709e1-d9bf-466b-9957-b9d04823680b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.480732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.481534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.481820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.482099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.492496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.493983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:26.511060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:26.512060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:26.513143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:26.513143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:26.513143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:26.513143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:26.513143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 642/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:26.518577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.598844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.618517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d24a-ce85-49b0-a453-412cf6012177 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.651279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.651927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.652208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.652484 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.653194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:26.653539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.654912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.666971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 624/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:26.672710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.768238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9cbe4-0889-401a-b837-9ebc87e71da7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.787495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.801522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.802292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.802572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.802842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.810112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.811545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:26.825350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:26.826477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:26.827641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 643/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:26.832915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.931324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a6b5-2b80-48c2-83e6-76c167c9cfa0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.964681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.965332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.965648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.965927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.966753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:26.967061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.968498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.977492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:26.986546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 625/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:26.992218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.091218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbdf7-e28c-4f9d-8768-a57c8430a790 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.126805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.127593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.127876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.128153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.138520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.139968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:27.157425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:27.158537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:27.160214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:27.160214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:27.160214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:27.160214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:27.160214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 644/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:27.166700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.261043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147ea-b6e8-4e9e-ae9e-29fed1812d51 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.293643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.294284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.294563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.294838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.295547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:27.295849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.297194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.307999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 626/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:27.314228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.346012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.413763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746032b4-c4b4-4945-896c-99f69b4d0187 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.447594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.448372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.448649 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.448917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.457315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.459037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:27.473587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:27.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:27.475564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 645/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:27.480673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.537620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.576951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c1f2-93d5-43db-a0ac-feaf8b32c5f4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.609371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.609970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.610250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.610717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.611363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:27.611666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.613098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ebb20-64f8-472a-b9e9-702fc6bcc750 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.624542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 627/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:27.630604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.718135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.727669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08b09-0825-4134-ae66-d961b03d5a41 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.762161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.763034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.763317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.763594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] PATH_INFO: `/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/94a2e4c690694f1b8cf0ced06d7715ba/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.765561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf63b5c6674e939c3268ef8fdc313e, user_id=94a2e4c690694f1b8cf0ced06d7715ba, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.767621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7e582-310f-4ca7-8e7f-47f15939db63 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.780816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 646/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:27 2022] PUT /identity/v3/projects/c5cf63b5c6674e939c3268ef8fdc313e/users/94a2e4c690694f1b8cf0ced06d7715ba/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:01:29.782105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911df8d-c30b-47c1-905e-e4d6f1d375f5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.782705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911df8d-c30b-47c1-905e-e4d6f1d375f5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.783675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911df8d-c30b-47c1-905e-e4d6f1d375f5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.784901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 628/1274] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:29.790073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.790504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.790604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.806866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:29.808030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:29.874359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 647/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:29.898159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911df8d-c30b-47c1-905e-e4d6f1d375f5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.000109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911df8d-c30b-47c1-905e-e4d6f1d375f5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.017881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.036658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.037371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.037681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.037963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.047672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:30.055293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.056512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:30.057875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 629/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:30.062380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.148570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.166501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9e2b-aee9-43d7-9d9f-2ffeb8b2c61f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.201753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.202424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.202712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.202992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.203744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.204054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.206090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.215752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 648/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.221504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.320103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61f6f-70f4-4159-b0c4-fe731c313bd7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.353470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.354249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.354530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.354803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.365445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.366867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:30.383830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.384875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:30.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:30.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:30.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:30.386050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 630/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:30.390692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.489753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b058-23a6-44ed-97f0-da6e7563112c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.523413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.524086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.524367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.524645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.525350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.525688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.527057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.538943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 649/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.544547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.575297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.643046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbdf57-a0b1-46d1-8eaf-580d524f1672 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.675860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.676640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.676919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.677196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.684361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.685818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:30.700244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.701403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:30.702447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 631/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:30.707061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.710808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.803725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112852eb-169f-4a85-9db5-058aefcccd60 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.836424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.837015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.837294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.837594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.838407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.838710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.840126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.857518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 650/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.863750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.950655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.960562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979082b-d493-4d2c-b1db-c2533aacd472 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.993389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.994041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.994321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.994595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.059742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.061171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.156861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.167861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 632/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:31.173817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.232656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.270722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d10-8e32-4612-bdb9-5540ca20a549 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.304017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.304787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.305067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.305341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.315375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.316822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:31.334454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:31.335481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:31.341037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:31.341037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:31.341037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:31.341037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:31.341037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 651/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:31.341332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.436786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250a5d5-acc9-4107-8154-1d1bd99a7eae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.469584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.470296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.470581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.470854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.471558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.471860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.473203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.483849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 633/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:31.489904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.587291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7219-a6c6-413e-a86d-ca923081b696 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.601166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.621456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.622221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.622498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.622767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.629189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.630641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:31.644121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:31.645189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:01:31.646482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 652/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:31.651310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.700706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.750375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359272-fd24-43ca-b42e-2eb8d6f35950 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.784872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.785546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.785834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.786116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.786899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.787208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.788631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e805a75-6c62-4089-b8f6-7808a649bf7d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.800884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 634/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:31.813322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.916710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242df13-f5bc-48db-bbe7-d83b36763afe None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.949099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.949765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.950048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.950325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.951194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] RBAC: Adding query filter params (role.id=9db7cad99fca4e13a5d148271b26d46d, scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e, user.id=94a2e4c690694f1b8cf0ced06d7715ba) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.951456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.952894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83169c62-6bbf-438b-8a23-38b6c894eb5b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.959188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 653/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/role_assignments?user.id=94a2e4c690694f1b8cf0ced06d7715ba&scope.project.id=c5cf63b5c6674e939c3268ef8fdc313e&role.id=9db7cad99fca4e13a5d148271b26d46d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.000149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5567e-3b5b-4fc4-a3cf-281e86199b62 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.000678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5567e-3b5b-4fc4-a3cf-281e86199b62 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.000678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5567e-3b5b-4fc4-a3cf-281e86199b62 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.002128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 635/1288] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:34.007188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.007571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.007746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.024571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:34.025786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:34.054992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.095339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 654/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:34.118489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5567e-3b5b-4fc4-a3cf-281e86199b62 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.219085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5567e-3b5b-4fc4-a3cf-281e86199b62 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.230273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.253940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.254666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.254951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.255231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.255880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.257248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:34.269678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:34.270861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:34.271721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 636/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:34.277030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.375133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38a5e-7601-4bb2-a0a3-dc025d5717c7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.411199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.412119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.412439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.412934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.414204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:34.414527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.415919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f66c4-0621-49e2-b350-a39529829838 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.421152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 655/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.427113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.525540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f4be-51d9-454a-ad8d-0ced1b8fedca None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.559173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.559819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.560102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.560379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.561078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:34.561402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.562774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a577b-586e-4b0b-aaad-6feb563c48e6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.567361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 637/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:36.560407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7384-64d3-4393-b2a0-a365e0c998db None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.560964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7384-64d3-4393-b2a0-a365e0c998db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.560964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7384-64d3-4393-b2a0-a365e0c998db None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.562363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 656/1293] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:36.567509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad42d-ab53-4570-a618-520eec540e8d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.567912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad42d-ab53-4570-a618-520eec540e8d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.568063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad42d-ab53-4570-a618-520eec540e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.584998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-163ad42d-ab53-4570-a618-520eec540e8d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:36.586182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-163ad42d-ab53-4570-a618-520eec540e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:36.615001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.651939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 638/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:36.675454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f7384-64d3-4393-b2a0-a365e0c998db None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.706676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.774625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f7384-64d3-4393-b2a0-a365e0c998db None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.806781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.807437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.807720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.807999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.808726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.810192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4a2c6-f27a-40e3-9594-e9dc9146aa09 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.823047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 657/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:36 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:38.855769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaceae3-5599-4b35-ab4e-db76fb7d7c41 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.856296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaceae3-5599-4b35-ab4e-db76fb7d7c41 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.856296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaceae3-5599-4b35-ab4e-db76fb7d7c41 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.857704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 639/1296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:38.863413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.863861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.863961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.880894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:38.882094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:38.951256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 658/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:38.973483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaceae3-5599-4b35-ab4e-db76fb7d7c41 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.075815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaceae3-5599-4b35-ab4e-db76fb7d7c41 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.116334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.117452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.117846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.118331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.119586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.121687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:39.140645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:39.142110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:39.143061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 640/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:39.149097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.168898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.248461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2dd4-44b3-42e1-94ac-ce37e80e1980 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.280901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.281573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.281884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.282776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.283552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:39.283853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.285227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.290462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 659/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:39.296378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.331251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.399584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39759811-69a1-4785-ab75-4696f0a2b6cd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.432164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.432822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.433105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.433407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.434323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] RBAC: Adding query filter params (interface=public, service_id=73719e80723245a291a8c82e46c19113, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:39.434638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.436000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e2078-46e7-41d9-9b85-48845bc59fac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.440973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 641/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/endpoints?service_id=73719e80723245a291a8c82e46c19113&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:39.446572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.527380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.545838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ab389-7241-4a9c-ad1a-ceee3a0689e9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.578198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.579375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.579673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.579957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.580629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.582027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a0f15-05fd-4b9a-8069-ba0b0d69f1e5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.588674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 660/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:41.609316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563d08-be3e-48ab-8ad9-195f11464b03 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:41.609844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563d08-be3e-48ab-8ad9-195f11464b03 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:41.609844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563d08-be3e-48ab-8ad9-195f11464b03 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:41.611947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 642/1302] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:41.616955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:41.617328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:41.617553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:41.634042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:41.635220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:41.701294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 661/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:41.725487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563d08-be3e-48ab-8ad9-195f11464b03 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:41.819169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:41.826107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563d08-be3e-48ab-8ad9-195f11464b03 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:41.860783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:41.861516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:41.861795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:41.862067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:41.862707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:41.864056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:41.875464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:41.877068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jun 20 06:01:41.877964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 643/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:41.882688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:41.957151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:41.980028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d4bfe-4fab-40bd-a08f-84a546a6e8fe None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:42.013811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:42.014461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.014745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.015021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.015718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:42.016023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:42.018223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b51d-8bd1-4416-bb5d-2432a74860c6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:42.023496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 662/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:42.029151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:42.124234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385330-1fa1-4ae5-a7de-f77db67b984a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:42.156418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:42.157041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.157320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.158250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.158998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:42.160347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd868d-a42b-4730-8817-5fdaed5f94d0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:42.178354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 644/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:52.020389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=30 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:52.174185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:44.893232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aae8-80ca-449c-980e-155a0eda5ddf None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:44.894362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aae8-80ca-449c-980e-155a0eda5ddf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:44.894922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aae8-80ca-449c-980e-155a0eda5ddf None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:44.896796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 663/1307] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:44.902134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5c03-f50e-4365-9c7c-a60d0e7c36e7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:44.902609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5c03-f50e-4365-9c7c-a60d0e7c36e7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:44.902694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff5c03-f50e-4365-9c7c-a60d0e7c36e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:44.988013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6fff5c03-f50e-4365-9c7c-a60d0e7c36e7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:44.989207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6fff5c03-f50e-4365-9c7c-a60d0e7c36e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:45.121803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 645/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:45.160809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:45.161528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:45.162292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:45.165241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 664/1309] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jun 20 06:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:45.171194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af3e6-30ab-4ed7-9d56-e7aa98a9829f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:45.171446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af3e6-30ab-4ed7-9d56-e7aa98a9829f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:45.171755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af3e6-30ab-4ed7-9d56-e7aa98a9829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:45.274103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e48af3e6-30ab-4ed7-9d56-e7aa98a9829f None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:45.275363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e48af3e6-30ab-4ed7-9d56-e7aa98a9829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:45.303347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:45.371649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 646/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jun 20 06:02:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:02:45.381330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:45.383425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:45.495322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ecb76-7b8f-4879-94e3-d6187430c66b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:45.571474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:45.572119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:45.572395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:45.572662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:45.574312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:45.631959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:45.690026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:45.691472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d40b5-1451-43b1-ac99-773bd188c665 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:45.711094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 665/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:48.099913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:48.100409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:48.100409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:48.101782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 647/1312] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:48.107225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce908-03f1-4921-94d9-3b63ac694c49 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:48.107653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce908-03f1-4921-94d9-3b63ac694c49 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:48.107931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce908-03f1-4921-94d9-3b63ac694c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:48.181995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-687ce908-03f1-4921-94d9-3b63ac694c49 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:48.183215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-687ce908-03f1-4921-94d9-3b63ac694c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:48.288307 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 666/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:48.330302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:48.331972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:48.452145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e4da2-0a26-4052-bda6-25c44e657ca6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:48.545630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:48.549535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:48.550672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:48.551167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:48.551448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:48.553219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:48.678844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:48.680291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481835-6982-45ac-ba6b-b5891c8ec64f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:48.701535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 648/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:51.074881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac37-9bae-408d-82b6-3940b5369fbc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.075411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac37-9bae-408d-82b6-3940b5369fbc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.075411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac37-9bae-408d-82b6-3940b5369fbc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.076776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 667/1315] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:51.082379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f95b4-ebf9-43b7-a432-a354c4fa1f64 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.082913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f95b4-ebf9-43b7-a432-a354c4fa1f64 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.083009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f95b4-ebf9-43b7-a432-a354c4fa1f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.147051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7e5f95b4-ebf9-43b7-a432-a354c4fa1f64 None None] MFA Rules not processed for user `28e28983c7344573b7ffb88ba74b923f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:51.148414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e5f95b4-ebf9-43b7-a432-a354c4fa1f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:51.202689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:51.250408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 649/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:51.316292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.316772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.317279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.319845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 668/1317] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jun 20 06:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:51.328900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6d21-f2e6-4acb-b651-f9951b3f66a0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.329428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6d21-f2e6-4acb-b651-f9951b3f66a0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.329728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6d21-f2e6-4acb-b651-f9951b3f66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.421079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b0a6d21-f2e6-4acb-b651-f9951b3f66a0 None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:51.422549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b0a6d21-f2e6-4acb-b651-f9951b3f66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:51.510154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 650/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jun 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:51.521749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:51.523535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:51.534379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:51.637274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304f36-11d2-4843-9838-a0e49ca9a6ff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:51.723851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:51.724881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.725414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.725840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.727671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:51.801218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:51.857014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:51.858575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6523762-e81e-47f0-b5fa-2ae874f9405d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:51.881066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 669/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:54.848480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:54.849046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:54.849046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:54.850417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 651/1320] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:54.855541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0adc-8b55-413a-8966-12b528bb3004 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:54.855920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0adc-8b55-413a-8966-12b528bb3004 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:54.856105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0adc-8b55-413a-8966-12b528bb3004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:54.927697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a64f0adc-8b55-413a-8966-12b528bb3004 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:54.928915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a64f0adc-8b55-413a-8966-12b528bb3004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.023564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 670/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:55.064153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:55.065737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.118860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:55.171579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748fcc-6ad7-42b8-989a-49d226d5b6cd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:55.244460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:55.245103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:55.245411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:55.245691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:55.247344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.342506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:55.356514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:55.357976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c94f6-ceb8-4ebf-a875-133329dd86d4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:55.375732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 652/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:58.115641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:58.116178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:58.116178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:58.117595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 671/1323] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:58.122955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4106301-48a5-4c12-8cf8-20a8a90e062b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:58.123402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4106301-48a5-4c12-8cf8-20a8a90e062b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:58.123536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4106301-48a5-4c12-8cf8-20a8a90e062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:58.190113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c4106301-48a5-4c12-8cf8-20a8a90e062b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:58.191350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c4106301-48a5-4c12-8cf8-20a8a90e062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.301089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 653/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:58.338682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:58.340234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.361806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:58.454350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed55ec-2102-496f-8ed2-8f5592304780 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:58.531939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:58.532581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:58.532860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:58.533133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:58.534821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.609553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:58.649793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:58.651136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87af9c-f237-4971-9e70-e2300750faa2 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:58.669545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 672/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:00.775598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:00.776109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:00.776109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:00.777446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 654/1326] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:00.783673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d735-47f5-4938-8409-9b6965a6207e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:00.784126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d735-47f5-4938-8409-9b6965a6207e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:00.784475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d735-47f5-4938-8409-9b6965a6207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:00.853159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-96a5d735-47f5-4938-8409-9b6965a6207e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:00.854431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-96a5d735-47f5-4938-8409-9b6965a6207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:00.954662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 673/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:00.995392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:00.996914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:01.057930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:01.102523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725822-e03f-4273-b585-d5eaa01a211c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:01.177650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:01.178307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:01.178589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:01.178865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:01.180597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:01.293685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:01.296389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:01.298425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851916f-044a-4c82-a856-0ce71fcce3d0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:01.317337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 655/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:03.425187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:03.425789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:03.425789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:03.427123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 674/1329] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:03.432390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063247b-2439-430a-8281-71b1771cbc4c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:03.432843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063247b-2439-430a-8281-71b1771cbc4c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:03.432938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063247b-2439-430a-8281-71b1771cbc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:03.498302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b063247b-2439-430a-8281-71b1771cbc4c None None] MFA Rules not processed for user `28e28983c7344573b7ffb88ba74b923f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:03.500068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b063247b-2439-430a-8281-71b1771cbc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:03.601148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 656/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:03.639771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:03.642122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:03.675224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:03.751280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071ee9-c985-452d-91f2-9bdb86e5d5f1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:03.828036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:03.828613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:03.828932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:03.829167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:03.830914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:03.911437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:03.943988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:03.945464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9f181-0fef-4be8-9d6d-f3a60be40d1e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:03.963590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 675/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:06.281363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:06.281917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:06.281917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:06.283331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 657/1332] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:06.288440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4f89-c742-40fc-bb8a-13a571aaa7ab None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:06.288853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4f89-c742-40fc-bb8a-13a571aaa7ab None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:06.288989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4f89-c742-40fc-bb8a-13a571aaa7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:06.353596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f0ed4f89-c742-40fc-bb8a-13a571aaa7ab None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:06.354806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f0ed4f89-c742-40fc-bb8a-13a571aaa7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:06.449012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 676/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:06.485157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:06.486724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:06.555067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:06.589204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffd3c4-4fc0-4363-9a40-2cdbbd520be7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:06.661868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:06.662505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:06.662781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:06.663051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:06.664684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:06.770970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:06.772391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6864eb-4889-496c-bf26-5b8735457604 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:06.783035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:06.792841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 658/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:08.893819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:08.894395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:08.894395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:08.895747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 677/1335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:08.901170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09ab9-28a0-4bfa-ad94-ff6564ad18c3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:08.901619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09ab9-28a0-4bfa-ad94-ff6564ad18c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:08.901736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b09ab9-28a0-4bfa-ad94-ff6564ad18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:08.966187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a5b09ab9-28a0-4bfa-ad94-ff6564ad18c3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:08.967462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5b09ab9-28a0-4bfa-ad94-ff6564ad18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:09.063900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 659/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:09.104693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:09.106257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:09.148494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:09.212156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12a64-a7d4-4a16-81e5-60b04f6bfa46 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:09.285216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:09.285878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:09.286161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:09.286438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:09.288071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:09.373538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:09.399455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:09.400837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78c58e-4bde-4788-bca3-9395006f0b5e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:09.418356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 678/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:11.891832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:11.892373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:11.892373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:11.893801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 660/1338] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:11.899131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecab1-3736-45df-943f-13ae2076665c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:11.899529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecab1-3736-45df-943f-13ae2076665c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:11.899684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecab1-3736-45df-943f-13ae2076665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:11.965150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dd6ecab1-3736-45df-943f-13ae2076665c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:11.966386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dd6ecab1-3736-45df-943f-13ae2076665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:12.060469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 679/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:12.097212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:12.098952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:12.176714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:12.205081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5a10f-615a-4374-b03d-120306c498e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:12.276380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:12.277021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:12.277311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:12.277637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:12.279288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:12.388072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:12.390120 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e169b-a230-4ac6-9bfe-bbe64cf9bea8 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:12.409244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 661/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:16.549143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:16.549730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:16.549730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:16.551121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 680/1341] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:16.556430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133fb1-6926-416f-aafc-b208f712b2d7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:16.556831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133fb1-6926-416f-aafc-b208f712b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:16.556984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133fb1-6926-416f-aafc-b208f712b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:16.563732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:16.631198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-45133fb1-6926-416f-aafc-b208f712b2d7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:16.632406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-45133fb1-6926-416f-aafc-b208f712b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:16.737202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 662/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:16.776074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:16.778241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:16.834451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:16.882150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002771-69ad-478d-bc85-77b9e886adea None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:16.885748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:16.886393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:16.886679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:16.886959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:16.896274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:16.898009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2205c-130e-41ba-ad58-0b79af95c781 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:16.908038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 681/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:19.570037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e44b-fa85-4de8-b412-f4ac65b21956 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.570596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e44b-fa85-4de8-b412-f4ac65b21956 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.570596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e44b-fa85-4de8-b412-f4ac65b21956 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.571979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 663/1344] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:19.577963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5485012-2286-4e9b-9e6d-cf668fb89509 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.578410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5485012-2286-4e9b-9e6d-cf668fb89509 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.578503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5485012-2286-4e9b-9e6d-cf668fb89509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.606416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a5485012-2286-4e9b-9e6d-cf668fb89509 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:19.608146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a5485012-2286-4e9b-9e6d-cf668fb89509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:19.689515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 682/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:19.729440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e44b-fa85-4de8-b412-f4ac65b21956 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:19.741400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e44b-fa85-4de8-b412-f4ac65b21956 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:19.744947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:19.745625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.745909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.746185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.757416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:19.758892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586164-83f3-4304-b5c8-680a4914459d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:19.770952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 664/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:23.721149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d548-9351-4240-8750-8196d87acad4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.721713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d548-9351-4240-8750-8196d87acad4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.721713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706d548-9351-4240-8750-8196d87acad4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.723090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 683/1347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:23.728258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb6e2-cf38-445a-bb89-400a459ac4ee None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.728695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb6e2-cf38-445a-bb89-400a459ac4ee None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.728938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb6e2-cf38-445a-bb89-400a459ac4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.746804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e5acb6e2-cf38-445a-bb89-400a459ac4ee None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:23.748056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e5acb6e2-cf38-445a-bb89-400a459ac4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:23.756495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 665/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:23.796410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706d548-9351-4240-8750-8196d87acad4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.807171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706d548-9351-4240-8750-8196d87acad4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.811122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.811752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.812033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.812308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.821801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.823243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bafec9-b714-4273-b78d-4160261b7294 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.833868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 684/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:28.971136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c634c0-ba5a-457f-a27a-863802dd755c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.972049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c634c0-ba5a-457f-a27a-863802dd755c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.972545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c634c0-ba5a-457f-a27a-863802dd755c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:28.974432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 666/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:28.979632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5367a5-289a-4891-b7ec-35b2c92b683e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.980047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5367a5-289a-4891-b7ec-35b2c92b683e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.980216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5367a5-289a-4891-b7ec-35b2c92b683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:29.054043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ef5367a5-289a-4891-b7ec-35b2c92b683e None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:29.055565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef5367a5-289a-4891-b7ec-35b2c92b683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:29.084492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:29.141544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 685/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:33.379275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9e3-b211-4b4c-af09-b995269d0885 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:33.380192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9e3-b211-4b4c-af09-b995269d0885 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:33.380474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9e3-b211-4b4c-af09-b995269d0885 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:33.381882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 667/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:33.387584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272996f-32be-4319-8be9-47383287cffa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:33.388004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272996f-32be-4319-8be9-47383287cffa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:33.388214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272996f-32be-4319-8be9-47383287cffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:33.408395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3272996f-32be-4319-8be9-47383287cffa None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:33.409737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3272996f-32be-4319-8be9-47383287cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:33.418693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 686/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:33.745841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=72 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:34.853604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053d55e-a721-4021-b771-01c58d14d2aa None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:34.854264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053d55e-a721-4021-b771-01c58d14d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:34.854264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053d55e-a721-4021-b771-01c58d14d2aa None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:34.855668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 668/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:34.860998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42fcb9-3e65-4775-9552-0a0f8e36ab6c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:34.861471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42fcb9-3e65-4775-9552-0a0f8e36ab6c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:34.861649 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42fcb9-3e65-4775-9552-0a0f8e36ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:34.879926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ff42fcb9-3e65-4775-9552-0a0f8e36ab6c None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:34.881120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ff42fcb9-3e65-4775-9552-0a0f8e36ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:34.890626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 687/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:38.511741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79a1a-b7d7-44bf-b52d-b074c85ac08d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.512247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79a1a-b7d7-44bf-b52d-b074c85ac08d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.512484 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79a1a-b7d7-44bf-b52d-b074c85ac08d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.514368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 669/1356] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:38.519665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed004-f87b-4150-b0a8-a03f643338d6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.520105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed004-f87b-4150-b0a8-a03f643338d6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.520219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed004-f87b-4150-b0a8-a03f643338d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.540685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5dbed004-f87b-4150-b0a8-a03f643338d6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:38.542070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5dbed004-f87b-4150-b0a8-a03f643338d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:38.551342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 688/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:38.605770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8107-2ad7-41a2-bb99-3ad55fc47293 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.606296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8107-2ad7-41a2-bb99-3ad55fc47293 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.606871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8107-2ad7-41a2-bb99-3ad55fc47293 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.608453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 670/1358] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jun 20 06:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:38.617409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be998d9-a13a-40d2-8ed2-6b78a8080847 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.618166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be998d9-a13a-40d2-8ed2-6b78a8080847 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.618756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be998d9-a13a-40d2-8ed2-6b78a8080847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.673628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3be998d9-a13a-40d2-8ed2-6b78a8080847 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:38.675044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3be998d9-a13a-40d2-8ed2-6b78a8080847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:38.767319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 689/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jun 20 06:03:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:38.775618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f8107-2ad7-41a2-bb99-3ad55fc47293 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:38.791889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f8107-2ad7-41a2-bb99-3ad55fc47293 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:38.797857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:38.798505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.798888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.799347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.808428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:38.810512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbb10-80cd-4ea7-9230-84cb89d39367 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:38.820520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 671/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:03:41.099526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd40f-0044-49e8-a9c0-140ec166767d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.100080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd40f-0044-49e8-a9c0-140ec166767d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.100080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd40f-0044-49e8-a9c0-140ec166767d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.101615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 690/1361] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:41.106601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367704-8b84-4aad-8371-e751a8f7f588 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.108131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367704-8b84-4aad-8371-e751a8f7f588 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.108131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367704-8b84-4aad-8371-e751a8f7f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.125717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-12367704-8b84-4aad-8371-e751a8f7f588 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:41.126921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-12367704-8b84-4aad-8371-e751a8f7f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:41.145783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 672/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:41.180117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd40f-0044-49e8-a9c0-140ec166767d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.196287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd40f-0044-49e8-a9c0-140ec166767d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.201342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.202092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.202290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.202584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.212401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.214032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad02ee-2d65-4ed4-820c-a9166173df4a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.225806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 691/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:43.646488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56594f1b-cc60-4b98-b7c6-40a7c0ab2abc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:43.647051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56594f1b-cc60-4b98-b7c6-40a7c0ab2abc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:43.647051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56594f1b-cc60-4b98-b7c6-40a7c0ab2abc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:43.648721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 673/1364] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:43.654084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e1b77-034f-4bc4-8586-96e011a563c1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:43.654883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e1b77-034f-4bc4-8586-96e011a563c1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:43.655169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e1b77-034f-4bc4-8586-96e011a563c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:43.673753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-767e1b77-034f-4bc4-8586-96e011a563c1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:43.674960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-767e1b77-034f-4bc4-8586-96e011a563c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:43.682837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 692/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:43.729717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5eab-55e3-40d9-a910-f06fbf69865c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:43.730109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5eab-55e3-40d9-a910-f06fbf69865c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:43.730449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5eab-55e3-40d9-a910-f06fbf69865c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:43.732535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 674/1366] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jun 20 06:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:43.738068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3d9c-3427-478a-8440-5ee57d71ee92 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:43.738438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3d9c-3427-478a-8440-5ee57d71ee92 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:43.738834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3d9c-3427-478a-8440-5ee57d71ee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:43.757320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c8eb3d9c-3427-478a-8440-5ee57d71ee92 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:43.758520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8eb3d9c-3427-478a-8440-5ee57d71ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:43.768599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 693/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jun 20 06:03:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:43.776696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5eab-55e3-40d9-a910-f06fbf69865c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:43.798083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5eab-55e3-40d9-a910-f06fbf69865c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:43.803617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:43.804249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:43.804526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:43.804800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:43.814285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:43.815884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e338fb-e59b-402b-ba6e-80061c2e8e89 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:43.825225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 675/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:45.939262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7784-5210-4262-87e2-d6992fa6a001 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.939819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7784-5210-4262-87e2-d6992fa6a001 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.939819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7784-5210-4262-87e2-d6992fa6a001 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.941165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 694/1369] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:45.946501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc566b-5fa0-4b36-953f-f13ea4f6de82 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.947240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc566b-5fa0-4b36-953f-f13ea4f6de82 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.947520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc566b-5fa0-4b36-953f-f13ea4f6de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.966238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-32cc566b-5fa0-4b36-953f-f13ea4f6de82 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:45.967420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-32cc566b-5fa0-4b36-953f-f13ea4f6de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:45.975499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 676/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:46.019434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b7784-5210-4262-87e2-d6992fa6a001 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:46.034651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b7784-5210-4262-87e2-d6992fa6a001 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:46.040240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:46.040876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.041159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.041463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.050880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:46.052656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6cc4a-3ce9-450a-a8ae-da2ff0bee97e service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:46.063590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 695/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:46.644197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc820-458e-47f2-80be-28fdff9b4453 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.644505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc820-458e-47f2-80be-28fdff9b4453 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.644782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc820-458e-47f2-80be-28fdff9b4453 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.646368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 677/1372] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:46.652086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818646-1254-4015-a0e2-b46a2085f436 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.652378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818646-1254-4015-a0e2-b46a2085f436 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.652660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818646-1254-4015-a0e2-b46a2085f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.671899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a2818646-1254-4015-a0e2-b46a2085f436 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:46.673097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a2818646-1254-4015-a0e2-b46a2085f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:46.681239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 696/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:47.028236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22e19-6289-47aa-965e-750260f9983b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:47.028236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22e19-6289-47aa-965e-750260f9983b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:47.028236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22e19-6289-47aa-965e-750260f9983b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:47.032538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 678/1374] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jun 20 06:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:47.035330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e57f6d-7c59-4e10-8978-9a349bbc6a6b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:47.035798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e57f6d-7c59-4e10-8978-9a349bbc6a6b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:47.035952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e57f6d-7c59-4e10-8978-9a349bbc6a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:47.046185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:47.092897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e8e57f6d-7c59-4e10-8978-9a349bbc6a6b None None] MFA Rules not processed for user `819e7ece10414befa043f4b84da6c1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:47.094692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e8e57f6d-7c59-4e10-8978-9a349bbc6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:47.163380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 697/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jun 20 06:03:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:47.173810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22e19-6289-47aa-965e-750260f9983b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:47.188806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22e19-6289-47aa-965e-750260f9983b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:47.193468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:47.194414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:47.194889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:47.195353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:47.207536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:47.210100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0774d4-fd01-47fe-846d-58641c1f7b2e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:47.222352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 679/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:48.214423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41623-7510-4ab5-aea5-2e7507cdf7d0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.214954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41623-7510-4ab5-aea5-2e7507cdf7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.214954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41623-7510-4ab5-aea5-2e7507cdf7d0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.217603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 698/1377] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:48.222906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ae0-d77f-467d-9ff2-e15b4e08fa22 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.223350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ae0-d77f-467d-9ff2-e15b4e08fa22 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.223479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ae0-d77f-467d-9ff2-e15b4e08fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.242756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fa9b8ae0-d77f-467d-9ff2-e15b4e08fa22 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:48.243985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa9b8ae0-d77f-467d-9ff2-e15b4e08fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:48.252885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 680/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:48.297465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41623-7510-4ab5-aea5-2e7507cdf7d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:48.313133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41623-7510-4ab5-aea5-2e7507cdf7d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:48.318821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:48.319465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.319749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.320031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.330212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:48.331837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f060c3-d0a8-49de-9be1-b0d22eda51bb service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:48.342178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 699/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:50.436294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71bd1-562f-4d9a-b8f2-5f6b41ed927e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:50.436802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71bd1-562f-4d9a-b8f2-5f6b41ed927e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:50.436924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc71bd1-562f-4d9a-b8f2-5f6b41ed927e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:50.438281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 681/1380] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:50.443582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c823-d14b-4117-b40d-655254666603 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:50.443986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c823-d14b-4117-b40d-655254666603 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:50.444147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c823-d14b-4117-b40d-655254666603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:50.462868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-94b8c823-d14b-4117-b40d-655254666603 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:50.464067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94b8c823-d14b-4117-b40d-655254666603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:50.472559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 700/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:50.517361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71bd1-562f-4d9a-b8f2-5f6b41ed927e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:50.532528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc71bd1-562f-4d9a-b8f2-5f6b41ed927e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:50.537974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:50.538610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:50.538895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:50.539178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:50.548240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:50.549850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe9d4-5516-4444-a417-340230228f4d service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:50.559570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 682/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:52.779839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a0af-cba5-4864-89e2-d4fc917a5c85 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:52.780359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a0af-cba5-4864-89e2-d4fc917a5c85 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:52.780359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a0af-cba5-4864-89e2-d4fc917a5c85 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:52.781789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 701/1383] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:52.787352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdfb4-11a4-4b28-8a7f-1afa11f0de2c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:52.787802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdfb4-11a4-4b28-8a7f-1afa11f0de2c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:52.787916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdfb4-11a4-4b28-8a7f-1afa11f0de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:52.807353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dc0bdfb4-11a4-4b28-8a7f-1afa11f0de2c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:52.808561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc0bdfb4-11a4-4b28-8a7f-1afa11f0de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:52.816672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 683/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:52.859264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0a0af-cba5-4864-89e2-d4fc917a5c85 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:52.874461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0a0af-cba5-4864-89e2-d4fc917a5c85 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:52.880333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:52.881056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:52.881450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:52.881807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:52.891673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:52.895354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00b0a-a29e-40e3-9707-dc26c55850a8 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:52.906461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 702/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:55.001220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8a54-6337-46ee-bc22-1ee74c1e683a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.001747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8a54-6337-46ee-bc22-1ee74c1e683a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.001864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8a54-6337-46ee-bc22-1ee74c1e683a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.004077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 684/1386] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:55.009626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bcc42-9626-4882-9942-88ba17bd4f6a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.010145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bcc42-9626-4882-9942-88ba17bd4f6a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.010247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bcc42-9626-4882-9942-88ba17bd4f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.029024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eb0bcc42-9626-4882-9942-88ba17bd4f6a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:55.030290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb0bcc42-9626-4882-9942-88ba17bd4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:55.038496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 703/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:55.091345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a8a54-6337-46ee-bc22-1ee74c1e683a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:55.106093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a8a54-6337-46ee-bc22-1ee74c1e683a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:55.112257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:55.112859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.113139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.113436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.122041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:55.123621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0b0d-ce2e-44ba-9422-793fc54666ae service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:55.133247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 685/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:57.452162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4e6-348d-4e34-8782-795a03f172d4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:57.452859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4e6-348d-4e34-8782-795a03f172d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:57.452859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4e6-348d-4e34-8782-795a03f172d4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:57.454097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 704/1389] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:57.459362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301e2c-7b3a-43b7-bfe0-fa39943be24c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:57.459854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301e2c-7b3a-43b7-bfe0-fa39943be24c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:57.460010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf301e2c-7b3a-43b7-bfe0-fa39943be24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:57.479898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cf301e2c-7b3a-43b7-bfe0-fa39943be24c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:57.481170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf301e2c-7b3a-43b7-bfe0-fa39943be24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:57.489967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 686/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:57.537124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb4e6-348d-4e34-8782-795a03f172d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:57.554540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb4e6-348d-4e34-8782-795a03f172d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:57.560553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:57.561191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:57.561509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:57.561789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:57.570356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:57.571991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51134-8a6f-4ff6-bebe-624c2ae9f9af service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:57.582247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 705/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:59.672929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131354-5350-4508-8903-80cab4204277 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:59.673520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131354-5350-4508-8903-80cab4204277 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:59.673672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131354-5350-4508-8903-80cab4204277 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:59.675604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 687/1392] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:59.680763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752f50-f226-4ec5-8d77-f7d905c9a468 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:59.681180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752f50-f226-4ec5-8d77-f7d905c9a468 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:59.681336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6752f50-f226-4ec5-8d77-f7d905c9a468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:59.699515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c6752f50-f226-4ec5-8d77-f7d905c9a468 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:59.701199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c6752f50-f226-4ec5-8d77-f7d905c9a468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:59.709218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 706/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:59.754147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131354-5350-4508-8903-80cab4204277 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:59.770339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131354-5350-4508-8903-80cab4204277 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:59.776957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:59.777461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:59.777750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:59.778083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:59.788729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:59.790398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf69f-7f34-4c27-8572-d48d8fd0b5aa service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:59.800171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 688/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:01.917437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba591-53bf-430c-802e-f4fa960b2734 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:01.917975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba591-53bf-430c-802e-f4fa960b2734 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:01.917975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba591-53bf-430c-802e-f4fa960b2734 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:01.920317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 707/1395] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:01.925607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163573-34ac-4d44-af30-c68652f3a9df None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:01.926002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163573-34ac-4d44-af30-c68652f3a9df None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:01.926159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163573-34ac-4d44-af30-c68652f3a9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:01.943994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ba163573-34ac-4d44-af30-c68652f3a9df None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:01.945168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ba163573-34ac-4d44-af30-c68652f3a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:01.952868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 689/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:01.995956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbba591-53bf-430c-802e-f4fa960b2734 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:02.010179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbba591-53bf-430c-802e-f4fa960b2734 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:02.016159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:02.016788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.017067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.017340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.025805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:02.027364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e34875-08cd-4241-a488-f2b21780800e service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:02.037754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 708/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:02.600024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006ec1-be80-43ee-95cc-b048d911ea89 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.600317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006ec1-be80-43ee-95cc-b048d911ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.600513 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006ec1-be80-43ee-95cc-b048d911ea89 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.601988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 690/1398] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:02.608075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25609-2d60-408b-a1a5-652693806980 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.608571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25609-2d60-408b-a1a5-652693806980 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.608857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25609-2d60-408b-a1a5-652693806980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.626647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aff25609-2d60-408b-a1a5-652693806980 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:02.627852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aff25609-2d60-408b-a1a5-652693806980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:02.636029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 709/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:02.691930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f417-2838-4b48-9a55-8851ff7c4869 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.692221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f417-2838-4b48-9a55-8851ff7c4869 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.692528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f417-2838-4b48-9a55-8851ff7c4869 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.693930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 691/1400] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jun 20 06:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:02.698895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd877b-6514-4237-9956-5cd6bd64301f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.699186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd877b-6514-4237-9956-5cd6bd64301f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.699471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd877b-6514-4237-9956-5cd6bd64301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.747860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dbcd877b-6514-4237-9956-5cd6bd64301f None None] MFA Rules not processed for user `6bee578760b649d7a8fc07d5e9770746`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:02.749054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbcd877b-6514-4237-9956-5cd6bd64301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:02.781440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:02.810153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 710/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jun 20 06:04:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:02.817882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1f417-2838-4b48-9a55-8851ff7c4869 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:02.828997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1f417-2838-4b48-9a55-8851ff7c4869 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:02.832529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:02.833153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.833465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.833739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.843701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:02.845128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ed06-284a-4afc-ab9f-f20e8b88a4ef service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:02.854683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 692/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:03.573541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b259-4ec4-423f-ac3f-c416aa8e9cc2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:03.574019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b259-4ec4-423f-ac3f-c416aa8e9cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:03.574117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b259-4ec4-423f-ac3f-c416aa8e9cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:03.623180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3c04b259-4ec4-423f-ac3f-c416aa8e9cc2 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:03.624376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3c04b259-4ec4-423f-ac3f-c416aa8e9cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:03.689834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 711/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:03.736114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e93e-dc72-4631-933c-ae4b7628289c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:03.736617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e93e-dc72-4631-933c-ae4b7628289c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:03.736714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e93e-dc72-4631-933c-ae4b7628289c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:03.738061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 693/1404] 10.222.0.16 () {54 vars in 942 bytes} [Mon Jun 20 06:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:03.744465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadfd79-8863-4793-bbc4-8e529cf94617 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:03.744816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadfd79-8863-4793-bbc4-8e529cf94617 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:03.745180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadfd79-8863-4793-bbc4-8e529cf94617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:03.794148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9eadfd79-8863-4793-bbc4-8e529cf94617 None None] MFA Rules not processed for user `573c370fec404be39c9a21fbafd43a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:03.795253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9eadfd79-8863-4793-bbc4-8e529cf94617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:03.866217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 712/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Mon Jun 20 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:03.876254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e93e-dc72-4631-933c-ae4b7628289c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:03.883747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=61 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:03.892111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e93e-dc72-4631-933c-ae4b7628289c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:03.897079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:03.898005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:03.898288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:03.898565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:03.907410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:03.908991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf468af-b59a-44af-a0eb-50600c01bd50 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:03.916917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 694/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:04:04.140779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56b30-d2b6-43f6-8238-94aba0e718aa None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:04.141089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56b30-d2b6-43f6-8238-94aba0e718aa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:04.141344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56b30-d2b6-43f6-8238-94aba0e718aa None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:04.146784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 713/1407] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:04:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:04.148416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5631-9eb7-4f36-93d1-06e3768b3a35 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:04.148710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5631-9eb7-4f36-93d1-06e3768b3a35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:04.148996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5631-9eb7-4f36-93d1-06e3768b3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:04.167425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-28bf5631-9eb7-4f36-93d1-06e3768b3a35 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:04.169349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-28bf5631-9eb7-4f36-93d1-06e3768b3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:04.177684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 695/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:04.224006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c56b30-d2b6-43f6-8238-94aba0e718aa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:04.239443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c56b30-d2b6-43f6-8238-94aba0e718aa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:04.245043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:04.245706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:04.246119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:04.246401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:04.255528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:04.257166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a3b2-aced-4670-b18d-50aabc9575ff service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:04.262722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:04.268811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 714/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:14.162938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:26.175897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c6b-0e01-4e73-a302-8eee0b854ecf None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:26.176565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c6b-0e01-4e73-a302-8eee0b854ecf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:26.176565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c6b-0e01-4e73-a302-8eee0b854ecf None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:26.177877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 696/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jun 20 06:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:26.182874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d84e5-abbc-4bd1-b70f-4f6aef4746b4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:26.183367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d84e5-abbc-4bd1-b70f-4f6aef4746b4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:26.183476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d84e5-abbc-4bd1-b70f-4f6aef4746b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:26.201449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-af5d84e5-abbc-4bd1-b70f-4f6aef4746b4 None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:26.202632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-af5d84e5-abbc-4bd1-b70f-4f6aef4746b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:26.213195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 715/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jun 20 06:04:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:26.228200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82e81-fb6a-477c-96c5-6475c8652e9f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:26.228489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82e81-fb6a-477c-96c5-6475c8652e9f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:26.228795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82e81-fb6a-477c-96c5-6475c8652e9f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:26.230307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 697/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jun 20 06:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:26.235073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af94b7-b7dc-45cc-9e7a-99c71988d192 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:26.235360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af94b7-b7dc-45cc-9e7a-99c71988d192 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:26.235638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af94b7-b7dc-45cc-9e7a-99c71988d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:26.253703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a4af94b7-b7dc-45cc-9e7a-99c71988d192 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:26.254896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a4af94b7-b7dc-45cc-9e7a-99c71988d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:26.264773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 716/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jun 20 06:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:28.769550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f270f-8ff6-44da-93d8-31becf3d5742 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:28.770122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f270f-8ff6-44da-93d8-31becf3d5742 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:28.770122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f270f-8ff6-44da-93d8-31becf3d5742 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:28.771511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:28.776807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af659945-80d8-4ba1-984a-75fda04c5780 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:28.777832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af659945-80d8-4ba1-984a-75fda04c5780 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:28.777944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af659945-80d8-4ba1-984a-75fda04c5780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:28.796001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-af659945-80d8-4ba1-984a-75fda04c5780 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:28.797201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-af659945-80d8-4ba1-984a-75fda04c5780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:28.805040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:28.848958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f270f-8ff6-44da-93d8-31becf3d5742 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:28.865873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f270f-8ff6-44da-93d8-31becf3d5742 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:28.871751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:28.872401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:28.872679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:28.872951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:28.883381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:28.885352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de02cb0-3bdb-453b-abc3-10460f351454 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:28.895133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 699/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:29.816588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6bf5-6088-46d4-b3f4-062186422137 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:29.817159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6bf5-6088-46d4-b3f4-062186422137 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:29.817159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6bf5-6088-46d4-b3f4-062186422137 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:29.818518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:29.823313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677d08-8192-4736-8235-294d06f1f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:29.823752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677d08-8192-4736-8235-294d06f1f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:29.824374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677d08-8192-4736-8235-294d06f1f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:29.844282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ac677d08-8192-4736-8235-294d06f1f7b2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:29.845511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac677d08-8192-4736-8235-294d06f1f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:29.853245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:30.003420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d6bf5-6088-46d4-b3f4-062186422137 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:30.018318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d6bf5-6088-46d4-b3f4-062186422137 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:30.023837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:30.024461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:30.024737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:30.025009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:30.033141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:30.034753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117dece-91e1-44f3-b383-b1f5b035cb32 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:30.043930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 719/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:30.947363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8360ec-1d88-4aa6-a916-c1505f6cf282 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:30.947947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8360ec-1d88-4aa6-a916-c1505f6cf282 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:30.947947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8360ec-1d88-4aa6-a916-c1505f6cf282 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:30.949962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:30.954894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10679a-a8b8-488d-9cd4-a75649c93f80 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:30.955279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10679a-a8b8-488d-9cd4-a75649c93f80 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:30.955473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10679a-a8b8-488d-9cd4-a75649c93f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:30.972827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2d10679a-a8b8-488d-9cd4-a75649c93f80 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:30.974051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2d10679a-a8b8-488d-9cd4-a75649c93f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:30.982105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:31.134475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8360ec-1d88-4aa6-a916-c1505f6cf282 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:31.149689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8360ec-1d88-4aa6-a916-c1505f6cf282 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:31.156544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:31.157188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:31.157496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:31.157773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:31.166372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:31.168272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c4df-1606-4e49-96a5-96c90939e2c2 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:31.177778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 702/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:04:32.043689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b734a-92e6-4c8b-bb31-050aa66dc593 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:32.044259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b734a-92e6-4c8b-bb31-050aa66dc593 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:32.044259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b734a-92e6-4c8b-bb31-050aa66dc593 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:32.045612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:32.050414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bb13-54d6-46dd-8c3e-e5694e0c9cff None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:32.050887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bb13-54d6-46dd-8c3e-e5694e0c9cff None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:32.050984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bb13-54d6-46dd-8c3e-e5694e0c9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:32.069158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8214bb13-54d6-46dd-8c3e-e5694e0c9cff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:32.070369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8214bb13-54d6-46dd-8c3e-e5694e0c9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:32.078415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:32.232333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b734a-92e6-4c8b-bb31-050aa66dc593 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:32.246655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b734a-92e6-4c8b-bb31-050aa66dc593 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:32.252057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:32.252686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:32.252973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:32.253251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:32.261247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:32.262929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaa5d6-d591-4eb4-93dd-197df7d10e25 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:32.272221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 722/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:33.139638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83297-e8e9-470e-9346-7f699dd529ab None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:33.140161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83297-e8e9-470e-9346-7f699dd529ab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:33.140296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83297-e8e9-470e-9346-7f699dd529ab None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:33.141649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:04:33.146486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe735-9628-4f24-8b62-b0c18e3487ee None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:33.146884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe735-9628-4f24-8b62-b0c18e3487ee None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:33.147035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe735-9628-4f24-8b62-b0c18e3487ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:33.165325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9eabe735-9628-4f24-8b62-b0c18e3487ee None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:33.166553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9eabe735-9628-4f24-8b62-b0c18e3487ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:33.174451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:33.328046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83297-e8e9-470e-9346-7f699dd529ab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:33.342806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83297-e8e9-470e-9346-7f699dd529ab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:33.348081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:33.348708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:33.348986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:33.349259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:33.358238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:33.359852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9c262-6189-4a08-a16b-7f63d4c9559f service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:33.369214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 705/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:34.185714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c67-b4dd-4d52-ab4d-c5c63722d4cc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.186260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c67-b4dd-4d52-ab4d-c5c63722d4cc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.186260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c67-b4dd-4d52-ab4d-c5c63722d4cc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.187615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:34.192744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fd42-bd11-4c47-bf73-2775aefd0c2b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.193151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fd42-bd11-4c47-bf73-2775aefd0c2b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.193295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fd42-bd11-4c47-bf73-2775aefd0c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.211848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d783fd42-bd11-4c47-bf73-2775aefd0c2b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:34.213031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d783fd42-bd11-4c47-bf73-2775aefd0c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:34.221339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:34.373561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6c67-b4dd-4d52-ab4d-c5c63722d4cc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:34.388774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6c67-b4dd-4d52-ab4d-c5c63722d4cc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:34.394154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:34.394780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.395061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.395340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.404208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:34.405826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951252dd-ee41-4caf-a7fe-47a528bbcc69 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:34.415003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 725/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:35.233177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283969b8-49a0-4065-a599-c4912fcef0cd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:35.233752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283969b8-49a0-4065-a599-c4912fcef0cd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:35.233752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283969b8-49a0-4065-a599-c4912fcef0cd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:35.235061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:35.239968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b441-25b5-4b0d-931d-a20bd32cc7cd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:35.240370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b441-25b5-4b0d-931d-a20bd32cc7cd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:35.240579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b441-25b5-4b0d-931d-a20bd32cc7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:35.258997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ddc3b441-25b5-4b0d-931d-a20bd32cc7cd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:35.260195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ddc3b441-25b5-4b0d-931d-a20bd32cc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:35.268587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:35.420009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283969b8-49a0-4065-a599-c4912fcef0cd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:35.435005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283969b8-49a0-4065-a599-c4912fcef0cd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:35.440376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:35.441007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:35.441290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:35.441595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:35.450239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:35.451813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebaeaa-0203-492f-b1a0-125582d983bc service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:35.461411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 708/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:36.289137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815d669-6d85-41a7-9fd6-4af5953cf0af None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:36.289748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815d669-6d85-41a7-9fd6-4af5953cf0af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:36.289748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815d669-6d85-41a7-9fd6-4af5953cf0af None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:36.291241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:36.296989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0a2b-fbb5-45b6-bd81-6ea65fc854d6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:36.297443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0a2b-fbb5-45b6-bd81-6ea65fc854d6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:36.297567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0a2b-fbb5-45b6-bd81-6ea65fc854d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:36.315408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-116c0a2b-fbb5-45b6-bd81-6ea65fc854d6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:36.316607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-116c0a2b-fbb5-45b6-bd81-6ea65fc854d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:36.324362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:36.474300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815d669-6d85-41a7-9fd6-4af5953cf0af None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:36.489018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815d669-6d85-41a7-9fd6-4af5953cf0af None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:36.494362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:36.494987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:36.495266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:36.495579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:36.504319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:36.505928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d529ab-c79b-40c2-999b-c3399884a63e service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:36.515120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 728/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:37.329331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7ae5-a95a-48d0-9c8e-e6b5e8d7d83e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.329895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7ae5-a95a-48d0-9c8e-e6b5e8d7d83e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.329895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad7ae5-a95a-48d0-9c8e-e6b5e8d7d83e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:37.331295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:37.336211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b80b0-f28a-4bb0-837c-08cdef1497cd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.336625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b80b0-f28a-4bb0-837c-08cdef1497cd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.336760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b80b0-f28a-4bb0-837c-08cdef1497cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:37.355239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b00b80b0-f28a-4bb0-837c-08cdef1497cd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:37.356420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b00b80b0-f28a-4bb0-837c-08cdef1497cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:37.364107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:37.515657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7ae5-a95a-48d0-9c8e-e6b5e8d7d83e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:37.530950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad7ae5-a95a-48d0-9c8e-e6b5e8d7d83e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:37.536345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:37.536977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.537259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.537572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:37.546275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:37.547859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f692-cf4f-4f50-ab30-ed4fa25f92b0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:37.557396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 711/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:39.506106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e9f5-91d7-4ed2-b3e3-5bde860ac457 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.506706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e9f5-91d7-4ed2-b3e3-5bde860ac457 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.506706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e9f5-91d7-4ed2-b3e3-5bde860ac457 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.508070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:39.513780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaa21-4cce-4ac7-b94b-05a076e11338 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.514198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaa21-4cce-4ac7-b94b-05a076e11338 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.514340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaa21-4cce-4ac7-b94b-05a076e11338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.532623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7dddaa21-4cce-4ac7-b94b-05a076e11338 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:39.533849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7dddaa21-4cce-4ac7-b94b-05a076e11338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:39.541593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:39.580718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e9f5-91d7-4ed2-b3e3-5bde860ac457 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:39.591929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e9f5-91d7-4ed2-b3e3-5bde860ac457 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:39.595435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:39.596054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.596331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.596605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.605347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:39.606785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80223e94-095e-4b77-aea2-9cc346b503f1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:39.616103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 731/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:41.786600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c747e0-e144-4668-8623-5f15a80c8fad None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.787185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c747e0-e144-4668-8623-5f15a80c8fad None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.787185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c747e0-e144-4668-8623-5f15a80c8fad None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.788558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:41.794288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d881fc-8e70-4423-825e-f83c577d1a21 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.794725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d881fc-8e70-4423-825e-f83c577d1a21 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.794828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d881fc-8e70-4423-825e-f83c577d1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.812965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-74d881fc-8e70-4423-825e-f83c577d1a21 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:41.814188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-74d881fc-8e70-4423-825e-f83c577d1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:41.821931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:41.861283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c747e0-e144-4668-8623-5f15a80c8fad None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:41.872694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c747e0-e144-4668-8623-5f15a80c8fad None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:41.876308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:41.876932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.877209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.877536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.886741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:41.888189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85445e8-190d-4c78-b6eb-05e1ba0502b4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:41.898295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 714/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:44.275407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.275887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.275981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.277402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:44.282633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c092b-7cdc-40b1-b784-ed2bef6c829f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.283038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c092b-7cdc-40b1-b784-ed2bef6c829f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.283185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c092b-7cdc-40b1-b784-ed2bef6c829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.300962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b33c092b-7cdc-40b1-b784-ed2bef6c829f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:44.302213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b33c092b-7cdc-40b1-b784-ed2bef6c829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:44.311935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:44.353341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:44.355251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:44.368053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8586e84-9546-4327-ac25-297259b67d8a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:44.372243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:44.372877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.373187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.373507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.382406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:44.383852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d5e5d-f1d9-4209-bd2e-69eb4972e253 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:44.394335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 734/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:46.594278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d903-82bc-4520-8b7b-1f20ce5dca60 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:46.594856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d903-82bc-4520-8b7b-1f20ce5dca60 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:46.594856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d903-82bc-4520-8b7b-1f20ce5dca60 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:46.596105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:46.601499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633a22-a5b8-48d2-919d-0dcb4646b7aa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:46.601948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633a22-a5b8-48d2-919d-0dcb4646b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:46.602088 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633a22-a5b8-48d2-919d-0dcb4646b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:46.622066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e2633a22-a5b8-48d2-919d-0dcb4646b7aa None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:46.623268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e2633a22-a5b8-48d2-919d-0dcb4646b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:46.631141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:46.670587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d903-82bc-4520-8b7b-1f20ce5dca60 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:46.681143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d903-82bc-4520-8b7b-1f20ce5dca60 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:46.685339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:46.685992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:46.686269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:46.686542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:46.695375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:46.696797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421681b6-5131-4aa9-9155-6c2c075df52a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:46.706667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 717/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:48.845463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4dcf2-4057-40ca-a365-b6dfe1fa700c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:48.846032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4dcf2-4057-40ca-a365-b6dfe1fa700c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:48.846032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4dcf2-4057-40ca-a365-b6dfe1fa700c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:48.847393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:48.852527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085d4e-ca5f-46ef-af45-dbf3db925c35 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:48.852964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085d4e-ca5f-46ef-af45-dbf3db925c35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:48.853118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085d4e-ca5f-46ef-af45-dbf3db925c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:48.871856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d6085d4e-ca5f-46ef-af45-dbf3db925c35 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:48.873054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d6085d4e-ca5f-46ef-af45-dbf3db925c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:48.880836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:48.919549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4dcf2-4057-40ca-a365-b6dfe1fa700c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:48.930238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4dcf2-4057-40ca-a365-b6dfe1fa700c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:48.934260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:48.934881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:48.935163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:48.935439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:48.944252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:48.945730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6101b7-ab1a-4796-9673-b82c7d8cabd3 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:48.956293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 737/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:51.087314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281f5a-31ef-48ef-af9e-d97dfa0424b4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:51.087889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281f5a-31ef-48ef-af9e-d97dfa0424b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:51.087889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281f5a-31ef-48ef-af9e-d97dfa0424b4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:51.089870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:51.095349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b91a-3ae4-4d07-aca0-733aa3eef360 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:51.095788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b91a-3ae4-4d07-aca0-733aa3eef360 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:51.096005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b91a-3ae4-4d07-aca0-733aa3eef360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:51.115231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6cc3b91a-3ae4-4d07-aca0-733aa3eef360 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:51.116429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6cc3b91a-3ae4-4d07-aca0-733aa3eef360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:51.124281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:51.163151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281f5a-31ef-48ef-af9e-d97dfa0424b4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:51.174970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281f5a-31ef-48ef-af9e-d97dfa0424b4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:51.178493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:51.179126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:51.179411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:51.179689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:51.188571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:51.190025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e477be-025c-4cc5-a95f-d30afadbac81 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:51.199336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 720/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:53.405275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952263-6889-4250-866e-a3a84d2782c3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:53.405854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952263-6889-4250-866e-a3a84d2782c3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:53.405854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952263-6889-4250-866e-a3a84d2782c3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:53.407227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:53.412609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f874-03ad-4060-929d-7e279f824465 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:53.413007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f874-03ad-4060-929d-7e279f824465 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:53.413177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f874-03ad-4060-929d-7e279f824465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:53.431106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c493f874-03ad-4060-929d-7e279f824465 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:53.432298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c493f874-03ad-4060-929d-7e279f824465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:53.440994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:53.478397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952263-6889-4250-866e-a3a84d2782c3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:53.489880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952263-6889-4250-866e-a3a84d2782c3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:53.493300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:53.493956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:53.494234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:53.494508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:53.503826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:53.505593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553526c4-3e9d-4cc3-b592-ff6fda34d21d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:53.515391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 740/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:55.603637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c1ff-3b26-43be-9bcc-94433481c7d5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:55.604169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c1ff-3b26-43be-9bcc-94433481c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:55.604169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c1ff-3b26-43be-9bcc-94433481c7d5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:55.605745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:55.611011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae89e-ed57-4e4c-a597-c0bea0de4778 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:55.611436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae89e-ed57-4e4c-a597-c0bea0de4778 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:55.611571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae89e-ed57-4e4c-a597-c0bea0de4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:55.617645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=79 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:55.630811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a09ae89e-ed57-4e4c-a597-c0bea0de4778 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:55.632007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a09ae89e-ed57-4e4c-a597-c0bea0de4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:55.640352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:55.678582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c1ff-3b26-43be-9bcc-94433481c7d5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:55.684133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=73 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:55.690476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c1ff-3b26-43be-9bcc-94433481c7d5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:55.693995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:55.694627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:55.694917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:55.695195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:55.704124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:55.705661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2c269-fec3-44c6-9541-f54f72af832b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:55.715463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 723/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:57.771771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad1ff-ebec-4ab2-b469-ca07c62efea1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.772585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad1ff-ebec-4ab2-b469-ca07c62efea1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.772585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad1ff-ebec-4ab2-b469-ca07c62efea1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.773971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:57.779145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742cc6-53d0-4304-8504-9f809892f26d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.779568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742cc6-53d0-4304-8504-9f809892f26d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.779728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742cc6-53d0-4304-8504-9f809892f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.797285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-46742cc6-53d0-4304-8504-9f809892f26d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:57.798495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-46742cc6-53d0-4304-8504-9f809892f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:57.806156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:57.842501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad1ff-ebec-4ab2-b469-ca07c62efea1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:57.853154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad1ff-ebec-4ab2-b469-ca07c62efea1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:57.856910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:57.857560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.857843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.858119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.866918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:57.868365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6c69-2141-41f6-811e-10f28d37ce32 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:57.878140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 743/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:59.957424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bda2-0413-4c91-9863-24f799e43bf7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:59.957994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bda2-0413-4c91-9863-24f799e43bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:59.957994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75bda2-0413-4c91-9863-24f799e43bf7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:59.959348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:59.965631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343be1-79df-4202-ab37-3cee32ad626c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:59.966071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343be1-79df-4202-ab37-3cee32ad626c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:59.966191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343be1-79df-4202-ab37-3cee32ad626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:59.984505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-83343be1-79df-4202-ab37-3cee32ad626c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:59.985731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-83343be1-79df-4202-ab37-3cee32ad626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:59.993722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:00.031438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75bda2-0413-4c91-9863-24f799e43bf7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:00.042678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75bda2-0413-4c91-9863-24f799e43bf7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:00.046206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:00.046832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.047115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.047389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.056213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:00.057666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a9303-21de-4e28-8557-9873af9e7623 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:00.066974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 726/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:09.979370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=11 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:10.062865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=14 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:20.424793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046a0f-5bb1-41c7-b787-92e1ec319f78 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:20.425423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046a0f-5bb1-41c7-b787-92e1ec319f78 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:20.425423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7046a0f-5bb1-41c7-b787-92e1ec319f78 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:20.426777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 745/1471] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:20.433979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1369629-1558-4a8e-86e2-e7accdddae76 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:20.434534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1369629-1558-4a8e-86e2-e7accdddae76 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:20.435046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1369629-1558-4a8e-86e2-e7accdddae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:20.455242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1369629-1558-4a8e-86e2-e7accdddae76 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:20.456440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1369629-1558-4a8e-86e2-e7accdddae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:20.464869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 727/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:20.512179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa57f7-2313-477a-ae84-ec808bc9645f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:20.512470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa57f7-2313-477a-ae84-ec808bc9645f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:20.512750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa57f7-2313-477a-ae84-ec808bc9645f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:20.514144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 746/1473] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jun 20 06:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:20.519119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2035-c5d9-4ad5-a9bb-cf3624a8af8e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:20.519354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2035-c5d9-4ad5-a9bb-cf3624a8af8e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:20.519633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2035-c5d9-4ad5-a9bb-cf3624a8af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:20.538272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dade2035-c5d9-4ad5-a9bb-cf3624a8af8e None None] MFA Rules not processed for user `6bee578760b649d7a8fc07d5e9770746`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:20.539451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dade2035-c5d9-4ad5-a9bb-cf3624a8af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:20.546818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 728/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jun 20 06:05:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:20.553867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa57f7-2313-477a-ae84-ec808bc9645f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:20.564544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa57f7-2313-477a-ae84-ec808bc9645f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:20.568061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:20.568677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:20.568960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:20.569236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:20.578315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:20.579739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43acd96-6de6-48d1-8ab6-ec0e79e881d0 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:20.590746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 747/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:22.723663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245f6-a0b1-4471-8212-11e79ab2c7dd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.724229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245f6-a0b1-4471-8212-11e79ab2c7dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.724229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1245f6-a0b1-4471-8212-11e79ab2c7dd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.725661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 729/1476] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:22.731287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505cec-fa86-4ebc-9766-987cfdd4692e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.731706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505cec-fa86-4ebc-9766-987cfdd4692e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.731852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505cec-fa86-4ebc-9766-987cfdd4692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.749162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e4505cec-fa86-4ebc-9766-987cfdd4692e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:22.750385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4505cec-fa86-4ebc-9766-987cfdd4692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:22.758065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 748/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:22.782015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1245f6-a0b1-4471-8212-11e79ab2c7dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:22.795116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1245f6-a0b1-4471-8212-11e79ab2c7dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:22.799565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:22.800207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.800494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.800771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.801539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:22.803429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:05:22.803429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:05:22.803429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:05:22.804577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0c6b-fe0f-466f-a860-d6dbc47e52b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:22.823521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 730/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jun 20 06:05:22 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:05:24.879206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc2a2-a8be-48ae-a330-510f04af770b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:24.879761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc2a2-a8be-48ae-a330-510f04af770b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:24.879761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc2a2-a8be-48ae-a330-510f04af770b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.881135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 749/1479] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:24.886775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361f12-fb01-447a-b9d3-26fce4e4d82b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:24.887279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361f12-fb01-447a-b9d3-26fce4e4d82b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:24.887429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361f12-fb01-447a-b9d3-26fce4e4d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.906806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fc361f12-fb01-447a-b9d3-26fce4e4d82b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:24.908167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc361f12-fb01-447a-b9d3-26fce4e4d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:24.917094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 731/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:24.959759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc2a2-a8be-48ae-a330-510f04af770b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:24.974730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc2a2-a8be-48ae-a330-510f04af770b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:24.980457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:24.981089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:24.981371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:24.981667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.990113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:24.991698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba291a-d448-4722-aac9-2f2c65feb36a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:25.001683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 750/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:27.217739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e5c-2eed-4e9b-aaa8-5bf84c204b47 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:27.218312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e5c-2eed-4e9b-aaa8-5bf84c204b47 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:27.218312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e5c-2eed-4e9b-aaa8-5bf84c204b47 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:27.219639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 732/1482] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:27.224861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805c7b-1177-4f05-bd28-8b0647db5c49 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:27.225277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805c7b-1177-4f05-bd28-8b0647db5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:27.225441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805c7b-1177-4f05-bd28-8b0647db5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:27.243461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fd805c7b-1177-4f05-bd28-8b0647db5c49 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:27.245096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd805c7b-1177-4f05-bd28-8b0647db5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:27.253058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 751/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:27.289418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0e5c-2eed-4e9b-aaa8-5bf84c204b47 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:27.299999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0e5c-2eed-4e9b-aaa8-5bf84c204b47 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:27.303423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:27.304045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:27.304324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:27.304593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:27.314055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:27.315505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53220-ecaa-4710-b67b-d738c313bf5a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:27.325838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 733/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:29.448182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d01a6-ef20-4ba4-8641-c94d59f9e983 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:29.448739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d01a6-ef20-4ba4-8641-c94d59f9e983 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:29.448739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d01a6-ef20-4ba4-8641-c94d59f9e983 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:29.450134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 752/1485] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:29.455426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543980f8-c758-454e-bf4c-0b8a290321c6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:29.455883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543980f8-c758-454e-bf4c-0b8a290321c6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:29.456046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543980f8-c758-454e-bf4c-0b8a290321c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:29.474385 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-543980f8-c758-454e-bf4c-0b8a290321c6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:29.475861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-543980f8-c758-454e-bf4c-0b8a290321c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:29.484446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 734/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:29.522553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d01a6-ef20-4ba4-8641-c94d59f9e983 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:29.533209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d01a6-ef20-4ba4-8641-c94d59f9e983 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:29.536729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:29.537349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:29.537660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:29.537930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:29.546931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:29.548372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e649e1-6d6a-45d6-bf2e-ce28acd1233f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:29.558107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 753/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:31.779607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325190-5eac-4359-8396-d682c9bfe178 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.780178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325190-5eac-4359-8396-d682c9bfe178 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.780178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325190-5eac-4359-8396-d682c9bfe178 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.781547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 735/1488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:31.786766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612e12-c58a-4ed5-8376-e29b09c334bd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.787211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612e12-c58a-4ed5-8376-e29b09c334bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.787325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612e12-c58a-4ed5-8376-e29b09c334bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.805557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7b612e12-c58a-4ed5-8376-e29b09c334bd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:31.806799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7b612e12-c58a-4ed5-8376-e29b09c334bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:31.814927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 754/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:31.856203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325190-5eac-4359-8396-d682c9bfe178 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:31.867217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325190-5eac-4359-8396-d682c9bfe178 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:31.870867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:31.871577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.871929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.872277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.881735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:31.883301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866dc96-499c-4df7-a075-656c6f477247 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:31.893983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 736/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:34.165248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba513-eda2-4157-b2ae-44ebaea53be9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.165818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba513-eda2-4157-b2ae-44ebaea53be9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.165818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba513-eda2-4157-b2ae-44ebaea53be9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.167221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 755/1491] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jun 20 06:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:34.173112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70004b44-9a16-4bd7-998f-7e32413a110f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.173589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70004b44-9a16-4bd7-998f-7e32413a110f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.173686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70004b44-9a16-4bd7-998f-7e32413a110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.192161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-70004b44-9a16-4bd7-998f-7e32413a110f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:34.193417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-70004b44-9a16-4bd7-998f-7e32413a110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:34.201466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 737/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:34.240197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba513-eda2-4157-b2ae-44ebaea53be9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:34.251675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba513-eda2-4157-b2ae-44ebaea53be9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:34.255163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:34.255785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.256063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.256335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.265816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:34.267260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375b8cb-7fdd-41c1-8ade-3bf548a49b24 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:34.277322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 756/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:44.187008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=33 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:44.272554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=33 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.099187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.099812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.099812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.118495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.119691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.127394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 738/1494] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.137454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.137960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.138056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.156392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.157699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.166090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 757/1495] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.170515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.181163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831bf6-1dcc-41c3-917e-07a4ea7fecda None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.185806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.186455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.186736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.187015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.187737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:24.188040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.189075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.189075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:07:24.189075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:07:24.190021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.202623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 739/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:24.211343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.221436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f813c1b-8860-4f0b-a4d3-48d2064d1bff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.225880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.226602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.226882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.227158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.227853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.229642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.229642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:07:24.229642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:07:24.230829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.269617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 758/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:24.275054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.286912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fe06-8718-4b8c-85f9-01dc78617501 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.345021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.345740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.346058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.346345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.347047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.348144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.348144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:07:24.348144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:07:24.349510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.368796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 740/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:24.372918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.384204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd054813-dbce-4ad5-83ce-6c2b3c3f658a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.388715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.389363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.389682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.389960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.390679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.391698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.391698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:07:24.391698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:07:24.392692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.407321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 759/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.411047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.420703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fecc-4ed8-4fd8-8dd0-606a20f58942 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.425195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.425921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.426220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.426499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.427215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.428276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.428276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:07:24.428276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:07:24.429223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73499305-113e-4aba-b5b6-014479b477e9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.442556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 741/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.447268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.456955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87d1a-f4ed-46a8-af03-97252714d254 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.462702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.463567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.463850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.464128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] PATH_INFO: `/v3/projects/2fbacbbc64604808a8f97b1d6d9273e0/users/c3271a03f98d466da767854f1a5c08eb/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.479991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbacbbc64604808a8f97b1d6d9273e0, user_id=c3271a03f98d466da767854f1a5c08eb, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.481047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.481047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:07:24.481047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:07:24.483077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d190b7-c3d2-404a-801a-3cb90771d36b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.496771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 760/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:24 2022] PUT /identity/v3/projects/2fbacbbc64604808a8f97b1d6d9273e0/users/c3271a03f98d466da767854f1a5c08eb/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.508775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65288-d531-45cf-aa9d-02dc514048dd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.509097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65288-d531-45cf-aa9d-02dc514048dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.509400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65288-d531-45cf-aa9d-02dc514048dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.536256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5fc65288-d531-45cf-aa9d-02dc514048dd None None] MFA Rules not processed for user `c3271a03f98d466da767854f1a5c08eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.537501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5fc65288-d531-45cf-aa9d-02dc514048dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.600757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 742/1502] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.614095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516e0-ead7-4d8c-a777-6857814fa186 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.614386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516e0-ead7-4d8c-a777-6857814fa186 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.614668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3516e0-ead7-4d8c-a777-6857814fa186 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.616059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 761/1503] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jun 20 06:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:24.621487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cae10-de83-4520-886b-50978efbd1db None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.621779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cae10-de83-4520-886b-50978efbd1db None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.622052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cae10-de83-4520-886b-50978efbd1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.640390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-840cae10-de83-4520-886b-50978efbd1db None None] MFA Rules not processed for user `819e7ece10414befa043f4b84da6c1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.641618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-840cae10-de83-4520-886b-50978efbd1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.686812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.696362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 743/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.704153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3516e0-ead7-4d8c-a777-6857814fa186 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.714651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3516e0-ead7-4d8c-a777-6857814fa186 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.718154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.718776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.719057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.719332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.727522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.728948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.737544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 762/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:24.780552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c0c-148e-4ed9-8f72-63a32ecdd67a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.780838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c0c-148e-4ed9-8f72-63a32ecdd67a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.781115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c0c-148e-4ed9-8f72-63a32ecdd67a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.782435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 744/1506] 10.222.0.16 () {52 vars in 829 bytes} [Mon Jun 20 06:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:24.785932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.848199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5f139-c513-4cb5-8c5e-43652fb7c99d service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.853370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.854200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.854483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.854760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] PATH_INFO: `/v3/users/c3271a03f98d466da767854f1a5c08eb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.855935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3271a03f98d466da767854f1a5c08eb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.856952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.856952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:07:24.856952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:07:24.858181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.923056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3271a03f98d466da767854f1a5c08eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.923842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3271a03f98d466da767854f1a5c08eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.942436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3271a03f98d466da767854f1a5c08eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.955068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3271a03f98d466da767854f1a5c08eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.959003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.965527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3271a03f98d466da767854f1a5c08eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.972264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 763/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:24 2022] DELETE /identity/v3/users/c3271a03f98d466da767854f1a5c08eb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.976740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51269-869c-441b-9fee-deb177a530dd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.977020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51269-869c-441b-9fee-deb177a530dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.977296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51269-869c-441b-9fee-deb177a530dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.995015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-14d51269-869c-441b-9fee-deb177a530dd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.996209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14d51269-869c-441b-9fee-deb177a530dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.056846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 745/1508] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:25.066818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.068254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.129138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6e73-a3c4-49a8-81ea-3c5df48d91aa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.132886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.133786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.134039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.134155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.143670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.145181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556d520-e9d9-43f1-8471-791ec3b3d18c service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.155056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 764/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:25.479215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51269-869c-441b-9fee-deb177a530dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.481038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14d51269-869c-441b-9fee-deb177a530dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.496042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51269-869c-441b-9fee-deb177a530dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.503158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.505057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.505617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.505967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] PATH_INFO: `/v3/projects/2fbacbbc64604808a8f97b1d6d9273e0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.508436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbacbbc64604808a8f97b1d6d9273e0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.510457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:25.510457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:07:25.510457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:07:25.513195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.577443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbacbbc64604808a8f97b1d6d9273e0', 'request_id': 'req-ca741b5f-2a48-4846-8cc7-254e653c2c86'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.586957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbacbbc64604808a8f97b1d6d9273e0', 'request_id': 'req-ca741b5f-2a48-4846-8cc7-254e653c2c86'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.593146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbacbbc64604808a8f97b1d6d9273e0', 'request_id': 'req-ca741b5f-2a48-4846-8cc7-254e653c2c86'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.613780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] The token cache is being invalidate because project 2fbacbbc64604808a8f97b1d6d9273e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:25.614073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.614743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca741b5f-2a48-4846-8cc7-254e653c2c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.618182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 746/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:25 2022] DELETE /identity/v3/projects/2fbacbbc64604808a8f97b1d6d9273e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:35.150861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:35.610775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:06.889507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.890134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.890134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.891467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:06.896588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2b4-5bdd-4bc6-b247-b455ccbfbdf3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.897039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2b4-5bdd-4bc6-b247-b455ccbfbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.897143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2b4-5bdd-4bc6-b247-b455ccbfbdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.915379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a452f2b4-5bdd-4bc6-b247-b455ccbfbdf3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:06.917127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a452f2b4-5bdd-4bc6-b247-b455ccbfbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:06.976516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:07.136499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:07.138333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:07.212884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6f62-71c6-46d9-b3c1-2d1c04454a5f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:07.218314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:07.218956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.219234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.219509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.227484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:07.229286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09b0c-7f34-458b-8d8c-8b04ebdceb1b service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:07.238536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 766/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:08.081894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce8d9-9b76-413e-9258-772bb80b88bb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.082471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce8d9-9b76-413e-9258-772bb80b88bb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.082471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce8d9-9b76-413e-9258-772bb80b88bb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.083849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:08.089342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600fe2-4e5c-410f-bcb1-a28d2ba78aa5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.089807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600fe2-4e5c-410f-bcb1-a28d2ba78aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.089934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600fe2-4e5c-410f-bcb1-a28d2ba78aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.108770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ee600fe2-4e5c-410f-bcb1-a28d2ba78aa5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:08.110045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ee600fe2-4e5c-410f-bcb1-a28d2ba78aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:08.117950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:08.278407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce8d9-9b76-413e-9258-772bb80b88bb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:08.294108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce8d9-9b76-413e-9258-772bb80b88bb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:08.299438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:08.300062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.300340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.300612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.309482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:08.311150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccaafc-776e-4b81-a959-c75403403e8c service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:08.321039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 749/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:08.730044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c735-cb3c-4a03-bd3d-429528c6241b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.730340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c735-cb3c-4a03-bd3d-429528c6241b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.730623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c735-cb3c-4a03-bd3d-429528c6241b None None] PATH_INFO: `/v3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.731939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 768/1517] 10.222.0.44 () {54 vars in 925 bytes} [Mon Jun 20 06:09:08 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:08.752640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668772-1ab2-4e81-843f-4c95dc38ef61 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.752928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668772-1ab2-4e81-843f-4c95dc38ef61 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.753208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668772-1ab2-4e81-843f-4c95dc38ef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.772090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dc668772-1ab2-4e81-843f-4c95dc38ef61 None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:08.773280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc668772-1ab2-4e81-843f-4c95dc38ef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:08.834234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 750/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Jun 20 06:09:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:17.730015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1c13-f567-46d4-bb5b-525666ae020a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.730580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1c13-f567-46d4-bb5b-525666ae020a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.730580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1c13-f567-46d4-bb5b-525666ae020a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.732366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 769/1519] 10.222.0.16 () {54 vars in 960 bytes} [Mon Jun 20 06:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:17.737535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bba-5ca5-40c8-b0f3-0737bc232b33 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.737955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bba-5ca5-40c8-b0f3-0737bc232b33 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.738154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bba-5ca5-40c8-b0f3-0737bc232b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.756471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8dec1bba-5ca5-40c8-b0f3-0737bc232b33 None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:17.757713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8dec1bba-5ca5-40c8-b0f3-0737bc232b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:17.766577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 751/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Mon Jun 20 06:09:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:17.774317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1c13-f567-46d4-bb5b-525666ae020a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:17.787504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1c13-f567-46d4-bb5b-525666ae020a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.792398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.793039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.793322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.793628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.802516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.804100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63cc14-ebd8-492d-ac44-f79a92f28417 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.814232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 770/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:19.559869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf3da-673c-4f98-9d2f-0cef69de46c3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.560405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf3da-673c-4f98-9d2f-0cef69de46c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.560529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf3da-673c-4f98-9d2f-0cef69de46c3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.561980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:19.566776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2237a-9192-4b04-ac7a-b1ee37ee75bf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.567230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2237a-9192-4b04-ac7a-b1ee37ee75bf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.567339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2237a-9192-4b04-ac7a-b1ee37ee75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.585896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-23e2237a-9192-4b04-ac7a-b1ee37ee75bf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:19.587101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-23e2237a-9192-4b04-ac7a-b1ee37ee75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:19.595734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:19.751535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf3da-673c-4f98-9d2f-0cef69de46c3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:19.766923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf3da-673c-4f98-9d2f-0cef69de46c3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:19.772781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:19.773439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.773721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.773996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.782558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:19.784142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260cd52-3d42-4d57-b838-5f354f5a4382 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:19.793452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 753/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:20.637356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3fb3-b108-4843-90be-97a008631ac4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:20.637948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3fb3-b108-4843-90be-97a008631ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:20.638122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3fb3-b108-4843-90be-97a008631ac4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:20.639452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:20.644159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101b2e-641d-4cc5-b8eb-177c085e84d1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:20.644608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101b2e-641d-4cc5-b8eb-177c085e84d1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:20.644706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101b2e-641d-4cc5-b8eb-177c085e84d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:20.663657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a101b2e-641d-4cc5-b8eb-177c085e84d1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:20.664860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a101b2e-641d-4cc5-b8eb-177c085e84d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:20.673267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:20.824417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3fb3-b108-4843-90be-97a008631ac4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:20.839166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3fb3-b108-4843-90be-97a008631ac4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:20.845155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:20.845808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:20.846093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:20.846370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:20.854466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:20.856042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762a80-afa9-4ec3-bad1-b777c9f85c3d service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:20.865466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 773/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:24.824795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:24.826072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:24.826072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:24.827576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:24.833116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3ee5-136e-4d14-8a22-59dbde0a49c3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:24.833572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3ee5-136e-4d14-8a22-59dbde0a49c3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:24.833689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3ee5-136e-4d14-8a22-59dbde0a49c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:24.852272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1edb3ee5-136e-4d14-8a22-59dbde0a49c3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:24.853499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1edb3ee5-136e-4d14-8a22-59dbde0a49c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:24.861345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:24.898219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:24.900082 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:24.957604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a162-7770-4c80-9991-2265c87435dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:24.961998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:24.962630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:24.962908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:24.963177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:24.971911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:24.973315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388882f-3c9f-463d-ad7a-a50e297b77c3 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:24.978137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:24.984677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 756/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:27.026878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:27.027468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:27.027468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:27.028855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:27.033935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345edc-281e-4402-abdf-5293e7eda7e6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:27.034356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345edc-281e-4402-abdf-5293e7eda7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:27.034490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345edc-281e-4402-abdf-5293e7eda7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:27.053342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0f345edc-281e-4402-abdf-5293e7eda7e6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:27.054562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f345edc-281e-4402-abdf-5293e7eda7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:27.062978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:27.098846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:27.100551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:27.114294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defe024-6091-4ff0-80a4-c70f2c970592 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:27.118493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:27.119157 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:27.119439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:27.119718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:27.129846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:27.131315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b07a4-d0d6-4a1d-baeb-b8ea678310d5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:27.141063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 776/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:30.607795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:30.608308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:30.608308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:30.609656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:30.614841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf55-ca0f-409d-8149-33f5d398fc77 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:30.615229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf55-ca0f-409d-8149-33f5d398fc77 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:30.615480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf55-ca0f-409d-8149-33f5d398fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:30.634243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5140cf55-ca0f-409d-8149-33f5d398fc77 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:30.635491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5140cf55-ca0f-409d-8149-33f5d398fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:30.643507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:30.945839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:30.947561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:31.009792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8b63-1690-4e8c-8c0e-7820006cf409 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.013454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.014100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.014383 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.014659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.023788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.025219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067ac2e-cc68-4187-9b34-c21c2cdcc8cd service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.035209 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 759/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:33.096630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.097170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.097170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.098597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:33.103663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe0cc-3b48-45ca-a8e2-a761f16db314 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.104106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe0cc-3b48-45ca-a8e2-a761f16db314 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.104239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe0cc-3b48-45ca-a8e2-a761f16db314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.122646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b1bbe0cc-3b48-45ca-a8e2-a761f16db314 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:33.123844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b1bbe0cc-3b48-45ca-a8e2-a761f16db314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:33.131547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:33.433490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:33.435529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:33.448690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1ba2-8def-41fa-93dc-9a54233b5874 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:33.452963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:33.453617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.453899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.454174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.462868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:33.464295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14589b-5df1-4406-85c4-ecdfe3ad1985 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:33.474329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 779/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:43.117020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=32 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:43.470244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=70 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.993967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4999ba-22aa-4b47-afec-ebd3bad94569 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.994638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4999ba-22aa-4b47-afec-ebd3bad94569 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.994638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4999ba-22aa-4b47-afec-ebd3bad94569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.024157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ec4999ba-22aa-4b47-afec-ebd3bad94569 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.025582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ec4999ba-22aa-4b47-afec-ebd3bad94569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.044919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 761/1540] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:03.059019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.059666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.059967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.072224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c201bc1-43a8-4707-b8ba-aa1650905cb5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.072677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c201bc1-43a8-4707-b8ba-aa1650905cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.074431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c201bc1-43a8-4707-b8ba-aa1650905cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.104794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.106912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.122520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 780/1541] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.129592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c201bc1-43a8-4707-b8ba-aa1650905cb5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.131654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c201bc1-43a8-4707-b8ba-aa1650905cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.161446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 762/1542] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.177431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887308eb-f84a-404b-863d-9a07afcedd66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.177431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887308eb-f84a-404b-863d-9a07afcedd66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.177431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887308eb-f84a-404b-863d-9a07afcedd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.185689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.215486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3827d5-a734-4b3a-a843-c195e948c6a7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.227588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.229024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.229645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-887308eb-f84a-404b-863d-9a07afcedd66 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.229994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.230666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.231603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-887308eb-f84a-404b-863d-9a07afcedd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.232456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.233327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.235321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:03.235321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:11:03.235321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:11:03.241706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33669f82-ec0a-4261-a6d9-5e0c5e184702 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.259757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 763/1543] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.262965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ddfb0-197d-42a4-8f5b-e332d8e7007a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.263451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ddfb0-197d-42a4-8f5b-e332d8e7007a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.263927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ddfb0-197d-42a4-8f5b-e332d8e7007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.275402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 781/1544] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.278401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.279188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.280184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.306404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.308220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.320101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b4ddfb0-197d-42a4-8f5b-e332d8e7007a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.320307 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 782/1545] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.321001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.321127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b4ddfb0-197d-42a4-8f5b-e332d8e7007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.332091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa6fc-c3b1-44b3-8981-f792d69c890c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.336577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.337076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 764/1546] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.338396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b52e9-c73b-4f69-9fe6-336628d7d2e0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.338685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b52e9-c73b-4f69-9fe6-336628d7d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.339002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b52e9-c73b-4f69-9fe6-336628d7d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.344886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.344886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.344886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.344886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.344886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.345575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a782fe-cc26-4c01-b8fd-a7b7e59c6c4a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.358855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 783/1547] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.360120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.360406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.360681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.363417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b81b52e9-c73b-4f69-9fe6-336628d7d2e0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.364657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b81b52e9-c73b-4f69-9fe6-336628d7d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.373643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 765/1548] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.374725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c28c8-711e-4b32-986d-fbef214615ff None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.375008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c28c8-711e-4b32-986d-fbef214615ff None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.375286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c28c8-711e-4b32-986d-fbef214615ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.382814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.384120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.393437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 784/1549] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.393596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-335c28c8-711e-4b32-986d-fbef214615ff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.394195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.394615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-335c28c8-711e-4b32-986d-fbef214615ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.403198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 766/1550] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.404472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee4cf-7dce-4ec1-b0b4-c73817fa7ad8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.406691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e5f1-ecfb-4f40-9ab5-8a6e72dbf7fa None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.406981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e5f1-ecfb-4f40-9ab5-8a6e72dbf7fa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.407261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7e5f1-ecfb-4f40-9ab5-8a6e72dbf7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.409412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.410078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.410362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.410643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.411340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.413286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57755d-3e53-4dad-b8ef-6995f3d3c04e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.425786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c0d7e5f1-ecfb-4f40-9ab5-8a6e72dbf7fa None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.426975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c0d7e5f1-ecfb-4f40-9ab5-8a6e72dbf7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.436400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 767/1551] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.437928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.438474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.438755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.440652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 785/1552] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.442133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5d0f-f3e9-47fc-938c-faed799444cf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.442603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5d0f-f3e9-47fc-938c-faed799444cf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.442891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5d0f-f3e9-47fc-938c-faed799444cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.457634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.458839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.461189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9a9f5d0f-f3e9-47fc-938c-faed799444cf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.462397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9a9f5d0f-f3e9-47fc-938c-faed799444cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.518201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 768/1553] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.518944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.522386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 786/1554] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.528324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30bc9f-9df0-473a-87f1-91b240c0379b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.532546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9270-75bf-4d2a-8d4a-c6f5f2b6e385 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.532864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9270-75bf-4d2a-8d4a-c6f5f2b6e385 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.533130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d9270-75bf-4d2a-8d4a-c6f5f2b6e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.533283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.533959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.534238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.534514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.535194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.536204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:03.536204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:11:03.536204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:11:03.537402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f9eb-872e-4ead-8f14-49c5e27bfd84 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.552815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c67d9270-75bf-4d2a-8d4a-c6f5f2b6e385 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.554351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c67d9270-75bf-4d2a-8d4a-c6f5f2b6e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.564084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 769/1555] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.564570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 787/1556] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.565980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.566264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.566538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.568858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.569092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.569370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.584538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.585759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.586896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.588053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.650046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 788/1557] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.650915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.660563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3315-3c69-4185-900d-fa0d5df13cbf None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.663022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 770/1558] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.663763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.665210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.665894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.666179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.666600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.667820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.668137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.669802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.673673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92265-5a19-447d-996b-8b5488d84c1f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.678418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.679078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.679361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.679632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.680311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.689596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 789/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.689596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.689874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646f8f-a748-40b3-8531-caab39ad4dc2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.692700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c27c1-16f9-4fa0-9d51-ca59479a6a66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.698046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.698729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.699051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.699337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.700039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.700347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.701991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.704441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 771/1560] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.705823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.706112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.706384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.713883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.718039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 790/1561] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.719637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.724469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.725689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.731082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318048c-f282-449d-ba31-e369cd6fe7ff admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.734830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 772/1562] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.735565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.736211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.736492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.736757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.737466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.738339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.738472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:03.738472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:11:03.738472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:11:03.739676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.748623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664d6b-ee8c-44d1-b045-07aca8dbe26e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.753789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.754512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.754779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.755059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.755890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.756194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.757806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.760243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.760586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 791/1563] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.761742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.772408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a485a4-96fe-4881-88f9-5237781a517b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.773679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 773/1564] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.774569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.777462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.778051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.778331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.778606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.779576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.779888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.781510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.785212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455da1-6d62-408b-a911-f5dfad68deb3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.790299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.790952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.791236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.791517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.792948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.793180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.800769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 792/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.800769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.801036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.804644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0705249-b69c-4bee-9f51-c241b4a260ad admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.808077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 774/1566] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.809116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.816114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.816765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.817047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.817321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.818037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.819166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ffd9-f1df-4d03-828a-4a753c6dc90d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.819934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.823770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.824419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.824709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.825136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.825904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.827475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.837832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 775/1567] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:03.839352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.849347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55e9c-b516-41a1-8033-e45d9ded20c8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.849806 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 793/1568] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.850906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.905342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.906015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.906293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.906566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.907244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.909195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.914254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d48ed-5d5d-4cda-b6d0-b62aeb0c9d61 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.919591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.920247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.920528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.920800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.921545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:03.921979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.923577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.942839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 794/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:03.942839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.943154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 776/1570] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:03.943154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.946760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c725-c594-4032-9aea-75001b2071e1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.003255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.003903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f658-0581-4853-a797-9d1e4d1caebb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.004370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.004370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.004759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.005519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.007124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.008761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.009976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.010258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.010577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.011274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.013149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.020129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 795/1571] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.020129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.028616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd281d-a1f9-4129-b44d-48945180e377 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.033439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.034073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.034353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.034628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.035310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.037215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.043553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 777/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.043553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.064300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 796/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.065239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.082653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.090022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.109439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6d862-fb51-4edb-8ad1-71e93a524610 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.135060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264c1f-6365-4dff-ab17-27723f0305f5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.140055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.140742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.141026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.141306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.142060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.143681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.154412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 797/1574] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.159336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.164736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57c19-9b3a-4724-8665-2da56cca51eb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.170159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.170810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.171091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.171369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.172084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.174015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.174797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.175462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.175746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.176026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.176721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.178671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.200159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 798/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.200159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.208286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109355-aac0-4f72-a2fb-23e58208cc94 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.209400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 778/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.210366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.266046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.266712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.267000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.267279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.267967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.269928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.271471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5cc88-8d7d-4477-a27e-389b7bfbedbc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.275997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.277269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.277570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.277843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.278536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.280533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.293261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 799/1577] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.293261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.303545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e92ec-e1d0-49bb-9bf9-090ef11fdc29 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.306549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 779/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.307504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.314747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.315431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.315710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.315991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.316733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.318380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.329952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 800/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.330756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.340895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4c76-574a-487a-aa99-c86f6d58ea03 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.378699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80342f69-497b-486c-bc1c-99a220658c0b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.383346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.384031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.384318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.384595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.385281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.387842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.394396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.397434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.398132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.398441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.398769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.399514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.402171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.409865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 780/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.410807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.420968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff710bf-6a2e-446d-a692-a46261806813 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.427132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 801/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.427132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.428673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.429565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.429850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.429992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.430141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] PATH_INFO: `/v3/projects/ae107b7f471d424898d8412c63f536c7/users/af22088a85464ce49a57d7faeba7a576/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.436677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c843f-d9c9-4db2-8cde-2ca7fdc7d923 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.441631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.442280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.442565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.442842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.443564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.445160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.445515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae107b7f471d424898d8412c63f536c7, user_id=af22088a85464ce49a57d7faeba7a576, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.446592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:04.446592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:11:04.446592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:11:04.449225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.456183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 802/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.457322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.466200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 781/1583] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:04 2022] PUT /identity/v3/projects/ae107b7f471d424898d8412c63f536c7/users/af22088a85464ce49a57d7faeba7a576/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:04.467188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.467926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b183cb-8201-4d01-86a4-8a58c05ccaff admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.529194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f1a5-a76e-49db-9e7f-da0772f1bd41 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.533905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.534076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.534511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.534723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.534838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.535012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.535130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.535313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.535741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.536035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.537733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.537874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.552507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 782/1584] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.552507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.562081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 803/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.562578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974859-3d2a-4694-bcc1-3f9d21c82f23 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.563560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.567653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.568508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.568793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.569069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.569805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.571702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.573580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a0d2-aa2f-4b6e-9423-8e5d5a058b90 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.578432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.579298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.579581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.579866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] PATH_INFO: `/v3/projects/0955a8e221d146fa90cea6bd42bddb53/users/c94a1d536a0f491dab3cf34a5b1e2d9b/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.593446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 783/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:04.594259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.599861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0955a8e221d146fa90cea6bd42bddb53, user_id=c94a1d536a0f491dab3cf34a5b1e2d9b, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.602587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.603836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1e8f-1e25-41be-b38b-e03d2c782fb0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.609647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.610303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.610663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.610853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.611667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.613306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.619206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 804/1587] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:04 2022] PUT /identity/v3/projects/0955a8e221d146fa90cea6bd42bddb53/users/c94a1d536a0f491dab3cf34a5b1e2d9b/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:04.619206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.629487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 784/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.630539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.640952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24b3c-30c4-443a-a0e6-795cb990e27d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.681477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7bfc-1d48-4f4d-aa05-bd98d8c8e564 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.686679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.687334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.687614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.687888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.688605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.690300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94033d-d2ee-46e5-b2c9-3335f2831c10 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.698115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.699168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.699632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.700067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.700261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 805/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.703405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20892f-c6de-4d70-9e45-8b14c8f4d378 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.703405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20892f-c6de-4d70-9e45-8b14c8f4d378 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.703405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20892f-c6de-4d70-9e45-8b14c8f4d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.705481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.707156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.719360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 785/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.720040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.730128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabe8a5-9b4e-40b4-ab82-1c697c64f1ab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.732161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fa20892f-c6de-4d70-9e45-8b14c8f4d378 None None] MFA Rules not processed for user `af22088a85464ce49a57d7faeba7a576`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:04.733363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa20892f-c6de-4d70-9e45-8b14c8f4d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:04.735067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.735757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.736042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.736322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.737058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.738733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.748751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 786/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.749584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.758780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785fd1-ee98-45b1-ad1c-3dd6ca071cd9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.763766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.764402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.764705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.764990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.765729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.767309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.778661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.779008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 787/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.779930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.789784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd0db-b1ac-45b4-abcf-8cb4a20053e2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.795006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.795646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.795928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.796208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.796923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.798556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.799821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.806672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 806/1593] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:04.807990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.808359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.808642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.810408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 788/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.811239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.824551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ed39-be3a-4e1b-9546-d1b094246923 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.828703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:04.829208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.829916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.830019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:04.830199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.830477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.831191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.832757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.837682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 807/1595] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:04.838463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.847141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 789/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.847141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.849481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9ca1-89a7-4b2d-a07f-eb57ec658eff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.856098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.856773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.857137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.857444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.858136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.858423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699f8b5-b7f3-4c6b-83d5-e7396af06003 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.859732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.863296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.864395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.864678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.865087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] PATH_INFO: `/v3/projects/65222fcb68584513887a66fe67454924/users/93915c757ffb4195b4848eb1b8bcd38e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.871391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 808/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:04.875910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.881074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65222fcb68584513887a66fe67454924, user_id=93915c757ffb4195b4848eb1b8bcd38e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.883770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.885573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9acf2-e763-414d-8667-51fa11bd5395 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.890434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.891325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.891664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.891895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] PATH_INFO: `/v3/projects/182c3d3a273742ebb2dbad3c96c5d565/users/1518331772ba4762a6a33bcc1ff26fcf/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.898364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 790/1598] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:04 2022] PUT /identity/v3/projects/65222fcb68584513887a66fe67454924/users/93915c757ffb4195b4848eb1b8bcd38e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:04.899268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.908261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182c3d3a273742ebb2dbad3c96c5d565, user_id=1518331772ba4762a6a33bcc1ff26fcf, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.911015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.928875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 809/1599] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:04 2022] PUT /identity/v3/projects/182c3d3a273742ebb2dbad3c96c5d565/users/1518331772ba4762a6a33bcc1ff26fcf/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:04.929794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.976902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e05e-c1e3-41eb-97dd-9a81c0fa750a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.000404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68caa-9bf7-4ff1-b451-71313d74cc99 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.005235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.005925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.006220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.006499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.007262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.008837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.019277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 810/1600] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:05.020005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.030470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e56-86ec-413b-9d18-921de164ea02 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.035441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.036330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.036615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.036715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.037192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] PATH_INFO: `/v3/projects/018cb579b1dd49db9062d4ddab9c9154/users/14bf1845390b4c7880c04ae568aea00a/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.037407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.037689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.037962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.038679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.040321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fd6dd-f88a-47f6-a922-9b6a88a4d1a3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.050727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 791/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:05.052320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650129ee-ebc0-46a6-9feb-1c0b21d589af None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.052607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650129ee-ebc0-46a6-9feb-1c0b21d589af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.052845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] RBAC: Authorizing `identity:create_grant(project_id=018cb579b1dd49db9062d4ddab9c9154, user_id=14bf1845390b4c7880c04ae568aea00a, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.052966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650129ee-ebc0-46a6-9feb-1c0b21d589af None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.055323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 792/1602] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jun 20 06:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:05.056123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650129ee-ebc0-46a6-9feb-1c0b21d589af None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.059101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.072768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 811/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:05 2022] PUT /identity/v3/projects/018cb579b1dd49db9062d4ddab9c9154/users/14bf1845390b4c7880c04ae568aea00a/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:05.074603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.118653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650129ee-ebc0-46a6-9feb-1c0b21d589af None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.135856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.138254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3991f8-d5fc-4fe6-9a2f-cb193cdd090a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.143324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.144221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.144505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.144785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] PATH_INFO: `/v3/projects/4a14899d6b2841e2b169556bb5aa22bd/users/2e7b6543931b4099a73005f791c1126b/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.160996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a14899d6b2841e2b169556bb5aa22bd, user_id=2e7b6543931b4099a73005f791c1126b, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.163687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998de56-d56a-4e23-a141-8ae041199824 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.166900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.172359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.172738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.173021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.173309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.180653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 812/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:05 2022] PUT /identity/v3/projects/4a14899d6b2841e2b169556bb5aa22bd/users/2e7b6543931b4099a73005f791c1126b/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:05.181948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.182291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.182632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.192356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.193853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5b7fd-018d-4c5a-aab7-f7fdbb0bf963 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.204320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 793/1605] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.205879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.206286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.206566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.209560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] MFA Rules not processed for user `93915c757ffb4195b4848eb1b8bcd38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.210761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.235012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] MFA Rules not processed for user `1518331772ba4762a6a33bcc1ff26fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.236240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.285266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 813/1606] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.286380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.321578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 794/1607] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.322258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.365155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b24df-1d13-4ab3-9214-09a192f67a03 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.372602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.373599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.373886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.374163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] PATH_INFO: `/v3/projects/de264f07cfb24b5c9f7ad13032991167/users/e5749b58fdc647719dda3396a8939f2b/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.390781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=de264f07cfb24b5c9f7ad13032991167, user_id=e5749b58fdc647719dda3396a8939f2b, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.393526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccba7a-cdc3-4cf3-83b6-d09c80a745ea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.403158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804751de-8675-46fc-8c36-fb9bc08b7aeb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.412087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 814/1608] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:05 2022] PUT /identity/v3/projects/de264f07cfb24b5c9f7ad13032991167/users/e5749b58fdc647719dda3396a8939f2b/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:05.413437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039d1c-f02e-4e16-a3ae-f7eed0c3346e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.413707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039d1c-f02e-4e16-a3ae-f7eed0c3346e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.413984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d039d1c-f02e-4e16-a3ae-f7eed0c3346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.434274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0d039d1c-f02e-4e16-a3ae-f7eed0c3346e None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.435526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0d039d1c-f02e-4e16-a3ae-f7eed0c3346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.489350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.491048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.491861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.492302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] PATH_INFO: `/v3/projects/0614a239ccf84b5da75a269f3a0c6363/users/f49340b89c2a43b288572263ddac7be8/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.496571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.505180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.513457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0614a239ccf84b5da75a269f3a0c6363, user_id=f49340b89c2a43b288572263ddac7be8, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.516464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ed26-3652-46af-94cd-81b3a3006331 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.522735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 815/1609] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.524432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.524746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.525125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.539862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 795/1610] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:05 2022] PUT /identity/v3/projects/0614a239ccf84b5da75a269f3a0c6363/users/f49340b89c2a43b288572263ddac7be8/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:05.541939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.542618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.543795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.544946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.546311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.580957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] MFA Rules not processed for user `2e7b6543931b4099a73005f791c1126b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.582869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.625021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 816/1611] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.626192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.679100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 796/1612] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.679100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.689261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1303fb5-7319-4ca1-ad0c-50432c36ae05 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.695170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.695829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.696202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.696431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.697150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.699390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd66add-0c62-4728-9a25-c41fae18edc1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.704499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c1a8c-3108-4f74-b01b-b7a1da6f825e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.708660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.709391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.709756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.710089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.728534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 797/1613] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:05.730699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5f75-0db3-49ff-b4c9-81321576d8bc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.730987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5f75-0db3-49ff-b4c9-81321576d8bc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.731264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5f75-0db3-49ff-b4c9-81321576d8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.762205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-711d5f75-0db3-49ff-b4c9-81321576d8bc None None] MFA Rules not processed for user `e5749b58fdc647719dda3396a8939f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.763419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-711d5f75-0db3-49ff-b4c9-81321576d8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.774893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.776390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.785949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 817/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.786737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.851219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.858953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 798/1615] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.860444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.860738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.861021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.879847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd21d6-5526-4588-b3f3-551a5cbcef34 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.917506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.919160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.991436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.997802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.998771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.999126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.999545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.028469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 799/1616] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:06.029501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.086920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.089766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.102724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2d729-ae25-4845-b96c-89f95cfe1c75 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.107048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.107783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.108142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.108496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.118218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 818/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:06.119603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.121525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.121941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.133690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 800/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:06.134589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.147066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ad91b-82fa-4dd9-9536-d120dc1bab2d service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.150743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56af3-feba-4c05-b0c9-2fbbf1a328e1 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.154703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.156930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.157231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.158140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.159152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.161113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11d84f-5216-4de9-96ae-28504731962d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.166944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.167799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.168199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.168620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.169357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.171464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.196833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 801/1619] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:06.199389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24693c8-3499-4274-97a7-21ecbdf505e5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.200013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24693c8-3499-4274-97a7-21ecbdf505e5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.200152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24693c8-3499-4274-97a7-21ecbdf505e5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.209669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 802/1620] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jun 20 06:11:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:06.210667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24693c8-3499-4274-97a7-21ecbdf505e5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.225102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24693c8-3499-4274-97a7-21ecbdf505e5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.230162 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.231130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.231719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.232248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.246132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.248802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1302bd5-b6e2-45de-97ea-ba80b5c98b8b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.261004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 819/1621] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:06.261004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.267285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 803/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:06.269371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.269681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.269953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.310636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:06.312694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:06.424424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 804/1623] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:06.427875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.436235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027176a2-1a68-40ee-94a0-9a9f7acc3be2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.446909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.449478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.449863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.450780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.451524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.454645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.455055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9117a-a821-4d0a-928e-9e5048de18f3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.463553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.466824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.467110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.467398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.469286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.474108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.482431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 820/1624] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:06.487178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.504510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:06.524125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 805/1625] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:06.524374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dc15-f18b-488a-ae08-b58c1b897355 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.524770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.537391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.539556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.539938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.540225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.550594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc19ef-b237-49dd-b40e-e0f59ceaa268 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.560629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.562745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.563028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.563304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] PATH_INFO: `/v3/projects/655124d4fb3d468682b5239335f887a1/users/ee3a45408a7144aba8499e6a804382b5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.719404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.721223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.743888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 821/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:06.745314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.778647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df873a-de2b-4bfd-841c-786ad5ac3070 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.793615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.794426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.794842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.795435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.796086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.797885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f8a6b-3ab6-4d31-8278-cc89d37a0145 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.809749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 822/1627] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:06.811664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabee8e-ebdc-4dda-ab77-f485e9b71e43 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.812062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabee8e-ebdc-4dda-ab77-f485e9b71e43 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.813182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabee8e-ebdc-4dda-ab77-f485e9b71e43 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.819658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 823/1628] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jun 20 06:11:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:06.821081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabee8e-ebdc-4dda-ab77-f485e9b71e43 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.836493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabee8e-ebdc-4dda-ab77-f485e9b71e43 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.842525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.843603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.844346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.844737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] PATH_INFO: `/v3/projects/011e69d2d2734b6c8941125f8e627dfd/users/43bbf359e6fb4642b00a7733e201d758/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.862207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011e69d2d2734b6c8941125f8e627dfd, user_id=43bbf359e6fb4642b00a7733e201d758, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.865784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba556-c4b3-4207-9684-80aad5737d28 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.892962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 824/1629] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:06 2022] PUT /identity/v3/projects/011e69d2d2734b6c8941125f8e627dfd/users/43bbf359e6fb4642b00a7733e201d758/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:06.894546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.895204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.896818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.944855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:06.950462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:07.014107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=655124d4fb3d468682b5239335f887a1, user_id=ee3a45408a7144aba8499e6a804382b5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.017256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.043144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 806/1630] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:06 2022] PUT /identity/v3/projects/655124d4fb3d468682b5239335f887a1/users/ee3a45408a7144aba8499e6a804382b5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:07.045518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.056057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:07.096875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 825/1631] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:07.098261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.194310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca2b0-01c1-4878-b4fc-e812c5bbe2ac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.196568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc569-0763-4a35-bd99-b18e617b0f91 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.202643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.203326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.203611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.203802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.203919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.204513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.204730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.204845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.205234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.205998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.206402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.208154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7a0e6-f692-4d8f-ad35-beabe600c67a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.214204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:07.229788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 807/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:07.232289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.245611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 826/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:07.245611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12b94-9b49-4f26-bbde-6944ec8ca792 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.245611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12b94-9b49-4f26-bbde-6944ec8ca792 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.245611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12b94-9b49-4f26-bbde-6944ec8ca792 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.247784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 827/1634] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jun 20 06:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:07.248530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12b94-9b49-4f26-bbde-6944ec8ca792 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.266253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12b94-9b49-4f26-bbde-6944ec8ca792 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.271629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.272762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.273074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.273306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] PATH_INFO: `/v3/projects/011e69d2d2734b6c8941125f8e627dfd/users/43bbf359e6fb4642b00a7733e201d758/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.275484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011e69d2d2734b6c8941125f8e627dfd, user_id=43bbf359e6fb4642b00a7733e201d758, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.278932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.290738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 828/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:07 2022] PUT /identity/v3/projects/011e69d2d2734b6c8941125f8e627dfd/users/43bbf359e6fb4642b00a7733e201d758/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:07.293552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.306907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053f7f6-d57c-491d-82ad-e13b1eccb09f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.384382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.385605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.386168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.386606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.395462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ecb4-a52a-443f-b0a1-6f6a1d4f2759 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.403051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.404116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.404481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.404824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] PATH_INFO: `/v3/projects/655124d4fb3d468682b5239335f887a1/users/ee3a45408a7144aba8499e6a804382b5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655124d4fb3d468682b5239335f887a1, user_id=ee3a45408a7144aba8499e6a804382b5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721f01-8a1c-450d-9a5c-686113b368c0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 829/1636] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:07 2022] PUT /identity/v3/projects/655124d4fb3d468682b5239335f887a1/users/ee3a45408a7144aba8499e6a804382b5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e18f2-e21e-43bc-9327-ca5912cf7a35 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e18f2-e21e-43bc-9327-ca5912cf7a35 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.469938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e18f2-e21e-43bc-9327-ca5912cf7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.493600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-847e18f2-e21e-43bc-9327-ca5912cf7a35 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:07.497188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-847e18f2-e21e-43bc-9327-ca5912cf7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:07.531953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:07.535465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.537452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e5b1-6c6d-41c3-a05b-95cd18f1095e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.552140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 808/1637] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:07.553596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.553952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.554146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.585985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] MFA Rules not processed for user `43bbf359e6fb4642b00a7733e201d758`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:07.587236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:07.617430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 830/1638] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:07.618744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.619187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.619332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.672773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] MFA Rules not processed for user `ee3a45408a7144aba8499e6a804382b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:07.674471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:07.728332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 809/1639] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:07.728332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.779110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:07.801924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 831/1640] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:07.803644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f163a-67ab-4870-a049-00ce8fb5ae98 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.809603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.810384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.810807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.811174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.823483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.825258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.856333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 810/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:07.916125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:07.929332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c347-8989-44c7-b39b-123620021e59 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:07.935830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:07.936776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:07.937062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:07.937450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:07.953677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:07.955335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:07.981807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 832/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:08.106891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:08.116884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413e09-3952-4788-a163-3a62bfad7e28 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:08.121632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:08.122508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:08.122980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:08.123305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:08.138283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:08.140578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:08.155119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 811/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:08.467470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:08.480434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbee79d-e083-489f-a263-deb0c021c3de service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:08.485139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:08.486525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:08.488043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:08.488481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:08.488905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:08.499161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c56b-5c75-4a9c-94ab-ddbe3e9df832 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:08.514767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:08.515610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:08.515997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:08.517013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:08.629286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:08.633948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573517c-d9a8-4e05-89e2-7b334aa1149f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:08.673169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 833/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:08.714921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:08.719240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5bb46-73df-4d07-80e9-68abfcfaff3a service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:08.747212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 812/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:15.198585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.200790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.201322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.277717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] MFA Rules not processed for user `f49340b89c2a43b288572263ddac7be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:15.279293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.399333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 834/1646] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:15.414762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b3a9-8f5a-4d5f-aefe-2c28d4579477 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.417591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b3a9-8f5a-4d5f-aefe-2c28d4579477 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.418773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b3a9-8f5a-4d5f-aefe-2c28d4579477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.490674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3106b3a9-8f5a-4d5f-aefe-2c28d4579477 None None] MFA Rules not processed for user `f49340b89c2a43b288572263ddac7be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:15.494723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3106b3a9-8f5a-4d5f-aefe-2c28d4579477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.531903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 813/1647] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:15.542714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:15.565514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3432a-3cdf-4bbb-86f4-9f8fba00d054 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:15.580356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:15.581931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.582275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.582639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.592700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:15.594373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e6d6d-3481-413a-8db2-2cb8b20abe44 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:15.608914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 835/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:16.430996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952afc9-0f69-4bf2-a87f-14130fdede4f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.431428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952afc9-0f69-4bf2-a87f-14130fdede4f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.433480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952afc9-0f69-4bf2-a87f-14130fdede4f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.437367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 814/1649] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jun 20 06:11:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:16.443845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a2bd-1631-42db-b8f2-262838926162 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.444292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a2bd-1631-42db-b8f2-262838926162 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.444461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a2bd-1631-42db-b8f2-262838926162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.531163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2044a2bd-1631-42db-b8f2-262838926162 None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:16.532907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2044a2bd-1631-42db-b8f2-262838926162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:16.607474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:16.665044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 836/1650] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:16.677235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952afc9-0f69-4bf2-a87f-14130fdede4f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:16.685784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:16.713306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952afc9-0f69-4bf2-a87f-14130fdede4f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:16.725645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:16.727309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.728895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.729814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.745344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:16.750169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71502-cd9a-4f6f-ae54-53cd2f4a8d93 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:16.762786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 815/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:17.653467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6c86-165a-454d-aa6e-0b405cc46d50 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.653959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6c86-165a-454d-aa6e-0b405cc46d50 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.654028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6c86-165a-454d-aa6e-0b405cc46d50 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.655984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 837/1652] 10.222.0.16 () {54 vars in 960 bytes} [Mon Jun 20 06:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:17.662856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a8f1-fa68-44ba-b9fc-f84f0b9fcf7e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.663311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a8f1-fa68-44ba-b9fc-f84f0b9fcf7e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.663405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a8f1-fa68-44ba-b9fc-f84f0b9fcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.713174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-13b3a8f1-fa68-44ba-b9fc-f84f0b9fcf7e None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:17.714853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-13b3a8f1-fa68-44ba-b9fc-f84f0b9fcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:17.742797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.743365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.743870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.780459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] MFA Rules not processed for user `f49340b89c2a43b288572263ddac7be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:17.780459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:17.795354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 838/1653] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:17.889613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 816/1654] 10.222.0.16 () {58 vars in 1057 bytes} [Mon Jun 20 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:17.896560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:17.934322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1eb4-201d-4383-a96a-af61d7230524 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:17.957279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:17.959689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.960130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.961722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.967840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:18.001675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:18.004682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b6961-340f-4820-af42-4d03f12c5913 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:18.046801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 839/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:18.649576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f8ea-8737-4e2b-b1f1-62e3cd146a3e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.649866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f8ea-8737-4e2b-b1f1-62e3cd146a3e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.650149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f8ea-8737-4e2b-b1f1-62e3cd146a3e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.657804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 817/1656] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jun 20 06:11:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:18.660124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.660603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.660692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.695047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:18.697145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:18.723005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 840/1657] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:18.737685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3f8ea-8737-4e2b-b1f1-62e3cd146a3e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:18.770201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3f8ea-8737-4e2b-b1f1-62e3cd146a3e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:18.771978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:18.778373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:18.779719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.780051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.780365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.789087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:18.790855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d40a-4679-433e-85f2-043bb215275f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:18.836279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 818/1658] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:18.925624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8bf9-63a4-4b23-81ec-6f7847049794 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.926508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8bf9-63a4-4b23-81ec-6f7847049794 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.926926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8bf9-63a4-4b23-81ec-6f7847049794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.982008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b6039-adf4-43bb-ae3a-472fcaa6225a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:19.008409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:19.008741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-014b8bf9-63a4-4b23-81ec-6f7847049794 None None] MFA Rules not processed for user `c94a1d536a0f491dab3cf34a5b1e2d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.012143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-014b8bf9-63a4-4b23-81ec-6f7847049794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.012390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.012728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.013129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] PATH_INFO: `/v3/users/e5749b58fdc647719dda3396a8939f2b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.039466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5749b58fdc647719dda3396a8939f2b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:19.044543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:19.175318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 819/1659] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.176901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a225b7-6a34-4a16-ae72-92d6dd3b8e89 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.177342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a225b7-6a34-4a16-ae72-92d6dd3b8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.178386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a225b7-6a34-4a16-ae72-92d6dd3b8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.200916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5749b58fdc647719dda3396a8939f2b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.203663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5749b58fdc647719dda3396a8939f2b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.245519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-65a225b7-6a34-4a16-ae72-92d6dd3b8e89 None None] MFA Rules not processed for user `14bf1845390b4c7880c04ae568aea00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.246922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-65a225b7-6a34-4a16-ae72-92d6dd3b8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.251926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5749b58fdc647719dda3396a8939f2b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.281991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5749b58fdc647719dda3396a8939f2b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.298623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bd4aacea-5205-444b-8d25-5a636bcbf0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5749b58fdc647719dda3396a8939f2b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.330868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 841/1660] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:18 2022] DELETE /identity/v3/users/e5749b58fdc647719dda3396a8939f2b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:19.332296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.332584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.332863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.353271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:19.387210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] MFA Rules not processed for user `c94a1d536a0f491dab3cf34a5b1e2d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.393533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.439262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 820/1661] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.440707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.441756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.442044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.499990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.501456 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.547200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:19.601470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 842/1662] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.642139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.643978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.690905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 821/1663] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.691998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.696141 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.714837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e50d-6f7a-4829-8281-badfb7e33735 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:19.747443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:19.748340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.748618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.748906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] PATH_INFO: `/v3/users/2e7b6543931b4099a73005f791c1126b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.750194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7b6543931b4099a73005f791c1126b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:19.751222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:19.751222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jun 20 06:11:19.751222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: Jun 20 06:11:19.752425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:19.778071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a3425-5568-4eea-9772-b767c25ac77f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:19.788513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:19.790654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.791229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.791748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.878532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7b6543931b4099a73005f791c1126b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.879659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7b6543931b4099a73005f791c1126b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.895311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:19.896743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7b6543931b4099a73005f791c1126b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.898566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:19.912021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7b6543931b4099a73005f791c1126b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.912738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7b6543931b4099a73005f791c1126b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.922026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 843/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:19.926532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.930212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.978221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 822/1665] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:19 2022] DELETE /identity/v3/users/2e7b6543931b4099a73005f791c1126b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:19.981975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.987664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.039468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ec06-fe02-4bf0-86e0-287d2e0aa8c0 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.189465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:20.195178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:20.206847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7451b8-49f1-4f7b-bd28-ab1602a8c0a6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.218719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.221776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.222005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.222340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.224395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.227208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.227974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.230609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.230997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.240786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.399339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.402345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81581746-8136-44f9-8223-9c49ea17727f service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.410755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.413746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.418706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 823/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:20.420168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.420459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.420948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.447973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:20.449606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 844/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:20.450892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.483873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 824/1668] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:20.495581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:20.497726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.519922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e920-d082-4722-b61f-88d9bdeb7051 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.532229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.533278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.534305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.534843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.555002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.580967 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.623747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 845/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:21.757233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:21.758845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.797582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc6d8-41a5-404c-811c-7b09a5a0734e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:21.834649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:21.835592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.835860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.836136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] PATH_INFO: `/v3/projects/4a14899d6b2841e2b169556bb5aa22bd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.847078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a14899d6b2841e2b169556bb5aa22bd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:21.849295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.037474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a14899d6b2841e2b169556bb5aa22bd', 'request_id': 'req-0cb8b762-886c-45a2-84a4-b68477afb15b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.044498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.046742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.055212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a14899d6b2841e2b169556bb5aa22bd', 'request_id': 'req-0cb8b762-886c-45a2-84a4-b68477afb15b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.082032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a14899d6b2841e2b169556bb5aa22bd', 'request_id': 'req-0cb8b762-886c-45a2-84a4-b68477afb15b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.114317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] The token cache is being invalidate because project 4a14899d6b2841e2b169556bb5aa22bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:22.115914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.117511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e70d-aedb-4a04-b64b-979d57b5431d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.118044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.127109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 825/1670] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:21 2022] DELETE /identity/v3/projects/4a14899d6b2841e2b169556bb5aa22bd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:22.129593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.131126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.303982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b762-886c-45a2-84a4-b68477afb15b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.327717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.328617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.328895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.329167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] PATH_INFO: `/v3/users/43bbf359e6fb4642b00a7733e201d758` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.336214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bbf359e6fb4642b00a7733e201d758)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.343710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.390557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.393008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.393906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.395959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] PATH_INFO: `/v3/projects/de264f07cfb24b5c9f7ad13032991167` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.398803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de264f07cfb24b5c9f7ad13032991167)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.402269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: WARNING py.warnings [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:22.402269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: warnings.warn(msg) Jun 20 06:11:22.402269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: Jun 20 06:11:22.404567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.448439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:22.569578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bbf359e6fb4642b00a7733e201d758'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.570751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bbf359e6fb4642b00a7733e201d758'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.584723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bbf359e6fb4642b00a7733e201d758'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.607047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de264f07cfb24b5c9f7ad13032991167', 'request_id': 'req-e260f93a-721c-4b7c-89cd-8437bb6e29e2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.617321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bbf359e6fb4642b00a7733e201d758'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.620663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b73989d9-b620-4c0b-9684-cf70e373d3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bbf359e6fb4642b00a7733e201d758'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.632093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de264f07cfb24b5c9f7ad13032991167', 'request_id': 'req-e260f93a-721c-4b7c-89cd-8437bb6e29e2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.665642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 826/1671] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:22 2022] DELETE /identity/v3/users/43bbf359e6fb4642b00a7733e201d758 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:22.667122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de264f07cfb24b5c9f7ad13032991167', 'request_id': 'req-e260f93a-721c-4b7c-89cd-8437bb6e29e2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.699201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] The token cache is being invalidate because project de264f07cfb24b5c9f7ad13032991167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:22.699553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.702014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e260f93a-721c-4b7c-89cd-8437bb6e29e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:22.705192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 846/1672] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:22 2022] DELETE /identity/v3/projects/de264f07cfb24b5c9f7ad13032991167 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:22.710060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.710998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.711533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.749052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:22.754054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.930695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 827/1673] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:22.940069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.940370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.940654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.975554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:22.976821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.038489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 847/1674] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:23.043418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.066444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b1afd-4c7f-442f-9eb9-219142db4566 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.099463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.101692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.104803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.106352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.110039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:23.111900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.117809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.180716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 828/1675] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:23.185922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.191679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:23.198043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0c0ad-c8f7-489b-bd64-e2d0feacf96c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.215784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.216619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.216982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.217329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.218129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.221190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92947bef-146d-4268-9c72-4da60aa5d696 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.345589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 848/1676] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:23 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:23.348766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.402977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.403276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.403568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.408824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6843f-ddf4-42b7-be44-88f9abc40c32 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.438953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] MFA Rules not processed for user `14bf1845390b4c7880c04ae568aea00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:23.440294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.631939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.635400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.635400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.637793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.649870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.652117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.673738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 849/1677] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:23.695727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.699736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.705119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 829/1678] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:23 2022] POST /identity/v3/users => generated 302 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:23.709672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.744236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8acb-ec9b-47fb-a42c-4a0b2d82f40b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.776049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.777970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.779126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.781910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.799740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3cf5-047f-4c2d-8842-af970c3f2c7d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.799937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.809551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.823721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.826667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.826667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.830400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] PATH_INFO: `/v3/projects/011e69d2d2734b6c8941125f8e627dfd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.845466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 830/1679] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:23.851629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011e69d2d2734b6c8941125f8e627dfd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.860201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.870668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.895388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:23.908877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4388c67-ca87-4488-9067-4ed03662798b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.923010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.923773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.925220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.926308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.927034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.935029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.971616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 831/1680] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:23.975137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.998709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011e69d2d2734b6c8941125f8e627dfd', 'request_id': 'req-074a591d-3572-447e-8eb6-d85d7fd503b7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.999114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968599-287b-4fe2-bb0b-1ac87f33de15 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.019952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011e69d2d2734b6c8941125f8e627dfd', 'request_id': 'req-074a591d-3572-447e-8eb6-d85d7fd503b7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:24.040369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011e69d2d2734b6c8941125f8e627dfd', 'request_id': 'req-074a591d-3572-447e-8eb6-d85d7fd503b7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:24.080226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] The token cache is being invalidate because project 011e69d2d2734b6c8941125f8e627dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:24.082870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:24.084154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-074a591d-3572-447e-8eb6-d85d7fd503b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:24.088739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 850/1681] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:23 2022] DELETE /identity/v3/projects/011e69d2d2734b6c8941125f8e627dfd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:24.097594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f8e49-e3b7-4da5-b979-cf59ae024734 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.098035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f8e49-e3b7-4da5-b979-cf59ae024734 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.099089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f8e49-e3b7-4da5-b979-cf59ae024734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.160486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b13f8e49-e3b7-4da5-b979-cf59ae024734 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.164376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b13f8e49-e3b7-4da5-b979-cf59ae024734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.200649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.201826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.202184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.202537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] PATH_INFO: `/v3/projects/8dabfc42b4904212b6e1012839d699c4/users/99800bc9c8d94a4686d6051fa018a12f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.266188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dabfc42b4904212b6e1012839d699c4, user_id=99800bc9c8d94a4686d6051fa018a12f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.274225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57324d-b971-4d0d-b0e7-1be5ab80fba7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.309928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 832/1682] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:23 2022] PUT /identity/v3/projects/8dabfc42b4904212b6e1012839d699c4/users/99800bc9c8d94a4686d6051fa018a12f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:24.311659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.311958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.312244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.364557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.365730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 851/1683] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.374273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.374614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.374749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.374913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.402784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.404093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.409334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:24.603008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 833/1684] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.617615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.618787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 852/1685] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:24.622572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.625228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.649410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f376f7a-7b16-45e4-af98-26499758bf78 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.663243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.664148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.664873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.666013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.668216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:24.668536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.679855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.706244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 853/1686] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:11:24.714339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.740312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe713e9-5e1d-42e7-99e6-81bb5a071f1a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.753194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.753966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.754499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.754827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.755528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.758578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.793017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d577e1-1367-48ca-97cd-2f3d09940560 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.799276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.800250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.800770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.801208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.827254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.833010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.850910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 854/1687] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:24.851981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.868025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 834/1688] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:25.024190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:25.027174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:25.081563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1f9b-ccca-44d9-aadc-a98d7ce4788d service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:25.133773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:25.155740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59b1e-f7a6-4cd9-b7ab-44ebd776d87b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:25.179281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:25.179975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.180259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.180535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.181234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:25.195654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.299790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:25.301577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.302004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.303228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] PATH_INFO: `/v3/users/af22088a85464ce49a57d7faeba7a576` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.307729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 855/1689] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/users => generated 291 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:25.308853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af22088a85464ce49a57d7faeba7a576)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:25.310126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:25.327500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.387538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcd384-ae64-4126-8cb7-0f62559371a9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:25.410247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:25.411146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.412073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.412528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.413578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:25.415503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.451859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 856/1690] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:25.456255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:25.487939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae06ba-e54b-4c44-ad0d-fe02cd6d0e86 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:25.490637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af22088a85464ce49a57d7faeba7a576'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:25.494842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af22088a85464ce49a57d7faeba7a576'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:25.512600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:25.513659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.514404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.514861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.515803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:25.521287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.524403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af22088a85464ce49a57d7faeba7a576'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:25.537839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af22088a85464ce49a57d7faeba7a576'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:25.538778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f4cde1a-d82d-4d0e-a97b-3aed084043eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af22088a85464ce49a57d7faeba7a576'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:25.542915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 857/1691] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:25.547235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:25.555891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:25.573233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908f63-957e-4f1d-bbd5-5bebd48b0e3a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:25.583674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:25.585812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.588426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.591508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] PATH_INFO: `/v3/projects/23b24fdecded42669b128212cd2ef844/users/246cd33b3e4f429098b47726fd77776c/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.638309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 835/1692] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:25 2022] DELETE /identity/v3/users/af22088a85464ce49a57d7faeba7a576 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:25.640992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42b254-2862-4fcd-a2c2-a19879d2d9d2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.641335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42b254-2862-4fcd-a2c2-a19879d2d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.641670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42b254-2862-4fcd-a2c2-a19879d2d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.647924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b24fdecded42669b128212cd2ef844, user_id=246cd33b3e4f429098b47726fd77776c, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:25.655597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950cf7a-ab1d-47bf-83a7-3292f6750e3a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.705927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 858/1693] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:25 2022] PUT /identity/v3/projects/23b24fdecded42669b128212cd2ef844/users/246cd33b3e4f429098b47726fd77776c/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:25.716410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.716697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.716975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.722113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0f42b254-2862-4fcd-a2c2-a19879d2d9d2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:25.723843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f42b254-2862-4fcd-a2c2-a19879d2d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:25.819352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] MFA Rules not processed for user `246cd33b3e4f429098b47726fd77776c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:25.820372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:25.857095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:25.886988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 836/1694] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:25.889024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:25.889489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:25.889915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:25.917961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:25.932622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:26.083857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:26.161284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 859/1695] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:26.162196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.163751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:26.167040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 837/1696] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:26.167987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.230392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8fd66-cb81-4322-9007-2c41fd4670f2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:26.248737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:26.251105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:26.253212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:26.255853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:26.259266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:26.267312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:26.346408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501e467-bdd5-467a-87de-ae5321d0e137 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:26.359546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:26.361004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:26.361398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:26.361742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:26.387398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 838/1697] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:26 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:26.389706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:26.391543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:26.391934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.428982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 860/1698] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:26.434365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.438185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:26.618317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9c142-e3cc-446d-b0d7-652e38183b8d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:26.659548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2f54-03a8-408b-b03d-a4d2a92027b2 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:26.660599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:26.664254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:26.665063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:26.668222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:26.669122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:26.681613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:26.785040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 839/1699] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:26 2022] POST /identity/v3/users => generated 297 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:26.786170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.843324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02080-6b37-4c28-a8ee-cb0203a604a7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:26.881286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:26.882205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:26.882588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:26.883163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:26.884045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:26.886422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:26.889158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:26.933637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 840/1700] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:26.940422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:26.953156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:26.953870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:26.954163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:26.954448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:26.981793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7c7f-e9ec-454f-b708-9633c639c346 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.003651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:27.008929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.012656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.013915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] PATH_INFO: `/v3/projects/4bd92cb81b314a3f9e03c4d699c88589/users/318fb09800e145e2958cac10eef7ab5a/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.052056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd92cb81b314a3f9e03c4d699c88589, user_id=318fb09800e145e2958cac10eef7ab5a, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.057529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.081782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.083440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.084402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 841/1701] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:26 2022] PUT /identity/v3/projects/4bd92cb81b314a3f9e03c4d699c88589/users/318fb09800e145e2958cac10eef7ab5a/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:27.088978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:27.113083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 861/1702] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:27.311494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91a72-4dad-4971-9f79-5033e029cdaa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.335668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:27.336410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.336710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.336964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.339645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.339645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.381848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:27.384004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.406814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816406-f4e3-4600-8a97-afa88165feb5 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.422846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:27.423855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.424191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.424575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] PATH_INFO: `/v3/users/93915c757ffb4195b4848eb1b8bcd38e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.429474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93915c757ffb4195b4848eb1b8bcd38e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.432059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.439861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 842/1703] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:27.440849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:27.520990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc111a5-19da-401c-ac71-0070e9ed3e4d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.522923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93915c757ffb4195b4848eb1b8bcd38e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.524824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93915c757ffb4195b4848eb1b8bcd38e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.545757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93915c757ffb4195b4848eb1b8bcd38e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.559594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93915c757ffb4195b4848eb1b8bcd38e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.561666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:27.571260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.571586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.571940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] PATH_INFO: `/v3/projects/4bd92cb81b314a3f9e03c4d699c88589/users/318fb09800e145e2958cac10eef7ab5a/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.573153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bb48ba44-e5c9-42dd-8117-1af4a8392f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93915c757ffb4195b4848eb1b8bcd38e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.591244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 862/1704] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:27 2022] DELETE /identity/v3/users/93915c757ffb4195b4848eb1b8bcd38e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:27.593798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.595759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.596231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd92cb81b314a3f9e03c4d699c88589, user_id=318fb09800e145e2958cac10eef7ab5a, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.596676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.627212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31073863-243e-4aea-96b9-e04bf6625de0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.664216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:27.671168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.685274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:27.714326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 843/1705] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:27 2022] PUT /identity/v3/projects/4bd92cb81b314a3f9e03c4d699c88589/users/318fb09800e145e2958cac10eef7ab5a/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:27.727109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.727756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.730721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.871770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 863/1706] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:27.878092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] MFA Rules not processed for user `318fb09800e145e2958cac10eef7ab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:27.882180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.107164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.108832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.133999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:28.153659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 844/1707] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:28.166546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.171647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.342499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f903e-797a-4f97-8ad0-d77d99ed5bf8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:28.344175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8de228-4303-4445-8ddc-2b25b0e26db0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:28.356607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.357616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.357824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.358175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.396992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.405564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.441893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 845/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:28.519884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.521521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.523300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.523814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.785909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.787869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d50e38-005d-43d8-a251-4570cda7e28d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.814266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 864/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:29.573431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:29.575674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:29.607813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142e230-d113-4cda-a310-4352c18bc238 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:29.626375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:29.627377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.629528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.630475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] PATH_INFO: `/v3/users/246cd33b3e4f429098b47726fd77776c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.635502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246cd33b3e4f429098b47726fd77776c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:29.640523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:29.801308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246cd33b3e4f429098b47726fd77776c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.804088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246cd33b3e4f429098b47726fd77776c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.842018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246cd33b3e4f429098b47726fd77776c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.862219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246cd33b3e4f429098b47726fd77776c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.862962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-341f14ac-3768-4a62-a5fc-ee570542d4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246cd33b3e4f429098b47726fd77776c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.913615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:29.934164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 846/1710] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:29 2022] DELETE /identity/v3/users/246cd33b3e4f429098b47726fd77776c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:29.936474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.937531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.938829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.980104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:29.982373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.221130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 865/1711] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:30.247689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.247981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.248307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.258045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.260178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.312927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:30.342567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:30.346115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.452466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab495fe-b8b6-4746-bafc-0b45acbba8da None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.459373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.460593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.461583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.462062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.482153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.484777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.507285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 866/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:30.650758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 847/1713] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Jun 20 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:30.874871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.877205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.911621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035b184-08fd-4947-88d8-2a7a796c2b5d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.933778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.934791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.934912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.937816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.961280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.965683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.988340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 867/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:32.617793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.623113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.654134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.655674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.656934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2851-0653-4ed7-a2b0-2e0ae1857e44 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:32.687392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:32.692498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.693284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.695810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357f77-773b-4d64-a9b9-2d0a492c0494 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:32.696130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] PATH_INFO: `/v3/projects/23b24fdecded42669b128212cd2ef844` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.702961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b24fdecded42669b128212cd2ef844)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:32.708082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:32.708614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:32.710625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.711309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.711864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] PATH_INFO: `/v3/projects/ae107b7f471d424898d8412c63f536c7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.713859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae107b7f471d424898d8412c63f536c7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:32.719848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:32.846985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b24fdecded42669b128212cd2ef844', 'request_id': 'req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.864786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b24fdecded42669b128212cd2ef844', 'request_id': 'req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.870792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae107b7f471d424898d8412c63f536c7', 'request_id': 'req-e7094432-6e98-42e5-9fb1-e5d7e5650550'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.878049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae107b7f471d424898d8412c63f536c7', 'request_id': 'req-e7094432-6e98-42e5-9fb1-e5d7e5650550'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.885824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b24fdecded42669b128212cd2ef844', 'request_id': 'req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.886652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae107b7f471d424898d8412c63f536c7', 'request_id': 'req-e7094432-6e98-42e5-9fb1-e5d7e5650550'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.918075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] The token cache is being invalidate because project ae107b7f471d424898d8412c63f536c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:32.918369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.919988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e7094432-6e98-42e5-9fb1-e5d7e5650550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.922973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 868/1715] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:32 2022] DELETE /identity/v3/projects/ae107b7f471d424898d8412c63f536c7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:32.923693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] The token cache is being invalidate because project 23b24fdecded42669b128212cd2ef844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:32.923977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.924812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.928081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846486-3611-4358-814d-ff7ca826c8bd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.928548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846486-3611-4358-814d-ff7ca826c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.928985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846486-3611-4358-814d-ff7ca826c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.933675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 848/1716] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:32 2022] DELETE /identity/v3/projects/23b24fdecded42669b128212cd2ef844 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:32.938094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.939888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.985540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a8846486-3611-4358-814d-ff7ca826c8bd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:32.989019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a8846486-3611-4358-814d-ff7ca826c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.090845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69493-3efa-4c05-a0c7-a5e9876a7ed9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.149979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:33.161208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 869/1717] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:33.163003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.163296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.163750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.187074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:33.198061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.200583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.202095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.202535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.202822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] PATH_INFO: `/v3/users/318fb09800e145e2958cac10eef7ab5a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.204827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] RBAC: Authorizing `identity:delete_user(user_id=318fb09800e145e2958cac10eef7ab5a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.207573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.226252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 870/1718] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:33.228086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.251362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166227b2-11e0-4b31-bd81-139f74733e2d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.262424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.263520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.265097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.265700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.266795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:33.267355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.282039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.315453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 871/1719] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:33.317892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.338708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318fb09800e145e2958cac10eef7ab5a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:33.340821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318fb09800e145e2958cac10eef7ab5a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:33.349807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318fb09800e145e2958cac10eef7ab5a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:33.359614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a78a-4dad-46d3-a89f-bee9d4dbf82d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.365593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.366235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318fb09800e145e2958cac10eef7ab5a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:33.366402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.366691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.367078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.368104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.370669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.371154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318fb09800e145e2958cac10eef7ab5a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:33.374916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:33.420690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 872/1720] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:33.426886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.429409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.430661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 849/1721] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:32 2022] DELETE /identity/v3/users/318fb09800e145e2958cac10eef7ab5a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:33.624218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae2fa-f710-4cb0-9837-6fc20b01940c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.638990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.640876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.641906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.642878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.645926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.653587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.717735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 873/1722] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/users => generated 279 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:33.720098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.874094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.876515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.882989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e711de-d345-4a98-acc3-69c1e5b0298b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.896710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a5ad-3518-491f-a188-6ce7b32cb396 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.904925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.905183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.906264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.906711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.907161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] PATH_INFO: `/v3/projects/65222fcb68584513887a66fe67454924` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.907269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.907521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.907806 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.908728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.909173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65222fcb68584513887a66fe67454924)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.910414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.912893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.926021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 850/1723] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:33.929736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.953348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910bca-f3dc-40a7-a6df-1613377b92a3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.960046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.960829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.961542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.961542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.962557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.964915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.986791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 851/1724] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:33.991072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:34.012677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679210b2-3d48-4b67-8fc9-11f808be407f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.034384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65222fcb68584513887a66fe67454924', 'request_id': 'req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.044158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65222fcb68584513887a66fe67454924', 'request_id': 'req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.077893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65222fcb68584513887a66fe67454924', 'request_id': 'req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.138839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] The token cache is being invalidate because project 65222fcb68584513887a66fe67454924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:34.139397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.140842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3e746c9b-7e6b-4f7c-887f-cec1dbbc5f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.161079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 874/1725] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:33 2022] DELETE /identity/v3/projects/65222fcb68584513887a66fe67454924 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:34.168373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c2bd-7f04-4ee9-b9ea-dcb7fa8d3943 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.168875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c2bd-7f04-4ee9-b9ea-dcb7fa8d3943 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.170232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9c2bd-7f04-4ee9-b9ea-dcb7fa8d3943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.182240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:34.242573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cdd9c2bd-7f04-4ee9-b9ea-dcb7fa8d3943 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.259266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cdd9c2bd-7f04-4ee9-b9ea-dcb7fa8d3943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.269649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.271450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.271737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.272819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 875/1726] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:34.286037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] PATH_INFO: `/v3/projects/507ae14995f0429a8239d0d0f6f08245/users/8da31fda780542e6b21e19f3445d3aac/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.300154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.301002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.301498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.329564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] RBAC: Authorizing `identity:create_grant(project_id=507ae14995f0429a8239d0d0f6f08245, user_id=8da31fda780542e6b21e19f3445d3aac, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.334421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a518e4-6057-45f9-a502-4612e293065e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.374667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 852/1727] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:33 2022] PUT /identity/v3/projects/507ae14995f0429a8239d0d0f6f08245/users/8da31fda780542e6b21e19f3445d3aac/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:34.385756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c39f-2cbe-4ab5-b22c-42fba49c4901 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.386118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c39f-2cbe-4ab5-b22c-42fba49c4901 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.386521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c39f-2cbe-4ab5-b22c-42fba49c4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.424244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.429255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.450677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4e00c39f-2cbe-4ab5-b22c-42fba49c4901 None None] MFA Rules not processed for user `8da31fda780542e6b21e19f3445d3aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.452597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4e00c39f-2cbe-4ab5-b22c-42fba49c4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.623946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:34.706858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 853/1728] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:34.724732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.725357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.725357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.752931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 876/1729] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:34.758086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:34.762613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.801773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44bc5b-58c2-4d21-9ccb-d36cfdf4f1d2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.815901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.816584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.816865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.817141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.817919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.819854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.870668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] MFA Rules not processed for user `99800bc9c8d94a4686d6051fa018a12f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.881466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.885831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 877/1730] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:34.887038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.084344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 854/1731] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:35.085663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.143749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eda37-768e-4031-95db-df30740ec387 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.164033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.166131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.166626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.167392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.168429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:35.168912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.170887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.201622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.205291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 878/1732] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:35.207485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.220637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:35.243574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430d17e-9e25-458c-a2a5-229e452d2244 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.261269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9733bd-d663-4101-8db0-2a56153ddfae admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.264003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.264843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.265188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.265620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.266641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.270032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.280375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.289704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.290849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.291913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.294102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.299293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.340514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 855/1733] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.340514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.357990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9112-1b78-4b01-9320-023535f9f5cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.366415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.367339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.367793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.368122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.370023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.372191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.381207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 879/1734] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.383017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.418028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 856/1735] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.419001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.463258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126a3e9-5c02-4cfa-bccd-1b9e1871790d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.553403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a799c-539d-4ea9-9ef5-2754997cf93c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.569586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.570311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.570822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.571103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.572913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.581273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.582333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.622054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.627266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.627957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.627957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.628712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.630441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.661735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 857/1736] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.664872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.670239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 880/1737] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:35.671897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.701880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883ae2-c509-4c31-ae79-c3253d96e127 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.711179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819c3a9-a4c9-42e2-b488-479e85ed4f11 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.712516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.716770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.718677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.719327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.721497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.723770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.734616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.735328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.735620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.735906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.736624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.738662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade7e0a-f351-4ff3-ad49-443c8d4347e6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.756044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 881/1738] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:35.761167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.796892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fca63-5b90-4a7a-9e26-0e473f83a651 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.819102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 858/1739] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.824525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951cd7-49ab-4658-ac8c-723bdcfb7b71 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.825743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951cd7-49ab-4658-ac8c-723bdcfb7b71 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.826055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951cd7-49ab-4658-ac8c-723bdcfb7b71 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.830534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 859/1740] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:11:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:35.833143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951cd7-49ab-4658-ac8c-723bdcfb7b71 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.835744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.838959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.840651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.841156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] PATH_INFO: `/v3/projects/4f0b361a20a249e39cee382c6b21696d/users/b2d7d412c8cf49b08d1be776eedc5813/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.885589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951cd7-49ab-4658-ac8c-723bdcfb7b71 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.896606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0b361a20a249e39cee382c6b21696d, user_id=b2d7d412c8cf49b08d1be776eedc5813, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.904242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.908218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.909480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.909747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.910034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] PATH_INFO: `/v3/projects/1ee78b0446584d32a0572b0630482f14/users/833d9bca716f46ec8691918aded091a0/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.960186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 882/1741] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:35 2022] PUT /identity/v3/projects/4f0b361a20a249e39cee382c6b21696d/users/b2d7d412c8cf49b08d1be776eedc5813/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:35.961588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.974008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee78b0446584d32a0572b0630482f14, user_id=833d9bca716f46ec8691918aded091a0, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.983059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.013430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 860/1742] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:35 2022] PUT /identity/v3/projects/1ee78b0446584d32a0572b0630482f14/users/833d9bca716f46ec8691918aded091a0/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:36.016375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.072624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210990e-bddb-49ea-96b2-41cd2cf73d45 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.196430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf384c3-3572-414e-b80c-967b075c07b8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.208001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.208756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.209043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.209752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.211889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.220683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.224932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:36.269336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 861/1743] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.272597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.320670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.343694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.345983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.346697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.348510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.357223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.374066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43433d1-be19-47c3-b319-d11564214c28 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.394182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.395344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.397251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.397798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.398852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.402892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c63f2-af2a-45a9-8349-c938e94d1fbf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.408049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 883/1744] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.415374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.445734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 862/1745] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.449734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755624f3-510b-4a09-9583-8c1cf0e27048 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.451334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755624f3-510b-4a09-9583-8c1cf0e27048 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.453254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755624f3-510b-4a09-9583-8c1cf0e27048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.472911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcb562-e6b7-4e7b-8bdf-b4e1d28eaa68 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.505297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-755624f3-510b-4a09-9583-8c1cf0e27048 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:36.506385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.507537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.507663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-755624f3-510b-4a09-9583-8c1cf0e27048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:36.507890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.508260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] PATH_INFO: `/v3/projects/4f0b361a20a249e39cee382c6b21696d/users/b2d7d412c8cf49b08d1be776eedc5813/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.514904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0b361a20a249e39cee382c6b21696d, user_id=b2d7d412c8cf49b08d1be776eedc5813, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.522361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.591102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 884/1746] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:36 2022] PUT /identity/v3/projects/4f0b361a20a249e39cee382c6b21696d/users/b2d7d412c8cf49b08d1be776eedc5813/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:36.592169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.705638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:36.720328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 863/1747] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:36.724526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ee3b-a835-4a78-a671-c5ca9f5f8209 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.725677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ee3b-a835-4a78-a671-c5ca9f5f8209 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.726191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ee3b-a835-4a78-a671-c5ca9f5f8209 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.731993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 864/1748] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:11:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:36.733168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ee3b-a835-4a78-a671-c5ca9f5f8209 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.781594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99850b-7f9a-45d0-a606-08763fbb86a8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.805100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.807323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.807553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.808999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.817306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.822756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daa1c-1def-4457-9dde-ba05adc38e09 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.863079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 885/1749] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.867089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.867426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.867728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.981567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] MFA Rules not processed for user `b2d7d412c8cf49b08d1be776eedc5813`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:36.987911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:36.999218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ee3b-a835-4a78-a671-c5ca9f5f8209 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.012962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.024747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.026270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.026571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] PATH_INFO: `/v3/projects/1ee78b0446584d32a0572b0630482f14/users/833d9bca716f46ec8691918aded091a0/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.032646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee78b0446584d32a0572b0630482f14, user_id=833d9bca716f46ec8691918aded091a0, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.040690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.082642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 865/1750] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:36 2022] PUT /identity/v3/projects/1ee78b0446584d32a0572b0630482f14/users/833d9bca716f46ec8691918aded091a0/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:37.084880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.248866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 886/1751] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:37.263205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.264863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.272336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d1f-3199-499b-9a40-f363ae506c5d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.300331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.305941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.307015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.311563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] PATH_INFO: `/v3/projects/ebf83c63e6844a0b889056b9a963d42e/users/83de857b81b14ea69946ab8a31c42d73/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.372733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf83c63e6844a0b889056b9a963d42e, user_id=83de857b81b14ea69946ab8a31c42d73, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.385315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b84bf-0af1-4c0c-b34e-5007a200f815 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.398203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:37.432644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 866/1752] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:37 2022] PUT /identity/v3/projects/ebf83c63e6844a0b889056b9a963d42e/users/83de857b81b14ea69946ab8a31c42d73/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:37.435772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539105a-dcc0-4fb9-8710-2bec2d57edc2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.436046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539105a-dcc0-4fb9-8710-2bec2d57edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.436328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539105a-dcc0-4fb9-8710-2bec2d57edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.485617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8539105a-dcc0-4fb9-8710-2bec2d57edc2 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:37.491017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8539105a-dcc0-4fb9-8710-2bec2d57edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.492514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdc2eb-e6e9-4752-b08f-3e6fbe7d82ce None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.674539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.676871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.677758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.678062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.733166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 867/1753] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:37.737148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.737461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.738235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.804842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:37.823502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] MFA Rules not processed for user `83de857b81b14ea69946ab8a31c42d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:37.825938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.863870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.865619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.899229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 887/1754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:37.900919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.910007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.951799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512e5a-c4e2-48ac-aaab-5d9b54750701 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.974697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.978725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.980258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.982206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.025821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.027932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.047828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 868/1755] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:38.048807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.055620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.063830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 888/1756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:38.068097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.096634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaebb7-8a82-4fa0-856e-0da0cefd57ca service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.111558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.114002 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.115524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.116395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.261826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.266729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c23ed-f0b3-495c-8592-9ff5848ccd75 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.267032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.282672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 889/1757] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:38.283736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.289308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.290301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.290658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.290943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] PATH_INFO: `/v3/projects/4bd92cb81b314a3f9e03c4d699c88589` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.296994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd92cb81b314a3f9e03c4d699c88589)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.302964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8861ee-3212-4d65-86e3-1bc1060c7ce4 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.304245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.318364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.319707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.321300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.323633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.324534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.333773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.371236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.436031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 890/1758] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:38 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:38.438105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.455349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd92cb81b314a3f9e03c4d699c88589', 'request_id': 'req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.473022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd92cb81b314a3f9e03c4d699c88589', 'request_id': 'req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.486761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd92cb81b314a3f9e03c4d699c88589', 'request_id': 'req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.535160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] The token cache is being invalidate because project 4bd92cb81b314a3f9e03c4d699c88589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:38.537746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.539459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.545444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 869/1759] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:38 2022] DELETE /identity/v3/projects/4bd92cb81b314a3f9e03c4d699c88589 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:38.550547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.553297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.700384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0545-e432-4d8f-aa6e-928ae1098d07 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.719731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.720427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.720716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.720997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.726580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.754465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21960-9db3-4de6-b3c8-ea68d7e66bdd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.792571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.794460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ff4bc-a38e-4f3c-afaf-47e6ecbc350a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.829793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 891/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:38.831338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1800a-a9ff-488c-a64b-c4ac0c708dae None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.831633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1800a-a9ff-488c-a64b-c4ac0c708dae None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.831917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1800a-a9ff-488c-a64b-c4ac0c708dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.871141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-18b1800a-a9ff-488c-a64b-c4ac0c708dae None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:38.872390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-18b1800a-a9ff-488c-a64b-c4ac0c708dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.896143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:39.008078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.008575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.008883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.009139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.013813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.019208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.034066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 892/1761] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:39.041723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.042054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.042342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.089632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 870/1762] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:38 2022] POST /identity/v3/users => generated 303 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:39.094552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.123943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:39.125408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:39.142682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074d68f-3212-4664-9ba2-21b1d8bb8897 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.149432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 893/1763] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:39.149702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.150572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.151169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.151573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.152460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.154571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.157676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.171702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cce5f-b4dc-493b-96c6-b0d446747cf9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.172683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 871/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:39.177138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.182670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.183427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.183680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.183972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.184714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:39.185029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.186747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.195514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709214b0-885b-4ca7-baf8-41c576f5c498 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.202736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.203859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 894/1765] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:39.204074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.204364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.204644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] PATH_INFO: `/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6/users/7e035a356a574b8f93e173eecda09e18/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.209434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.219570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8337-e9f1-4dcc-8ef5-f1ccd563518a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.229295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94141afdad84724bf98aa4cbf5ba3d6, user_id=7e035a356a574b8f93e173eecda09e18, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.232340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.233993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.234671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.234953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.235230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.235931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.238713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.251793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 872/1766] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:39 2022] PUT /identity/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6/users/7e035a356a574b8f93e173eecda09e18/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:39.255632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.284725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:39.312354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 895/1767] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:39 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:39.317540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.516316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a23b-7264-449f-aed7-5ff912cb9e0e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.616491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8effa-7d36-4beb-a463-7de9c1e8876d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.639000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.644346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.644346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.644587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.648291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.660432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.724753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 896/1768] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:39 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:39.726265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.731569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.733174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.734257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.736809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.738105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.751634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.756127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e775-1c90-4dba-a5b6-9851be3fc06c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.766156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.767572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.767718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.768092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.768833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.772848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.783402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 873/1769] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:39.787517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.802356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b36e73-0394-4370-8df6-7e04528c03f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.808754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.812689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 897/1770] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:39.812823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.812823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.812823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] PATH_INFO: `/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6/users/7e035a356a574b8f93e173eecda09e18/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.813850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.829138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94141afdad84724bf98aa4cbf5ba3d6, user_id=7e035a356a574b8f93e173eecda09e18, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.840387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577579-697e-4743-b571-2274477a15c5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.847558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63b0a-10ac-4a3e-866f-acaed6923c2f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.867066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:39.867816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.868041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.868414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.869810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:39.875647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:39.896984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 874/1771] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:39 2022] PUT /identity/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6/users/7e035a356a574b8f93e173eecda09e18/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:39.899429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:39.900054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:39.900459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:39.912265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 898/1772] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:39.912754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:39.935692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558f621-77d8-4a6d-8bd8-f7ea416597fd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:39.958514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] MFA Rules not processed for user `7e035a356a574b8f93e173eecda09e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:39.960059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.078833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.120568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.132079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.135441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.135953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] PATH_INFO: `/v3/projects/f92e56af8309465a9fd1375d92fb590d/users/d0e62085a945478db4a00369214594e9/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.176547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 875/1773] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:40.193136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.194959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.218722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92e56af8309465a9fd1375d92fb590d, user_id=d0e62085a945478db4a00369214594e9, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.226339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eee33-1e2b-4063-b8a4-e2db9b2e5294 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.257655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 899/1774] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:39 2022] PUT /identity/v3/projects/f92e56af8309465a9fd1375d92fb590d/users/d0e62085a945478db4a00369214594e9/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:40.264092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.270532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.271536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.271850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.331499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9645-fe1c-4388-b893-c9e7741ac78e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.333283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] MFA Rules not processed for user `d0e62085a945478db4a00369214594e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:40.334949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.461714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 900/1775] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:40.461714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.472097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.473678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.474611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.475700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.605578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9b6d-c5a6-4a38-a618-d0f8c1b688b9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.609016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.611650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.619122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.620111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.620783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.620783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.622663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.626798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.649957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 876/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:40.705180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 901/1777] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:40 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:40.708952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.723157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd023a-6757-4ce7-bd5c-c6ab58c1f46d service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.726560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.730596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.787742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.800111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.800902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.801097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.801432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.802439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.804531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.814692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822aff1-5bd6-4fcb-99f0-a4e2ebeff708 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.819438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.820095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.820374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.820643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.823897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.826659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 877/1778] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:40 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:40.830243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.841348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449bc1a-b33d-4e65-9a21-d63ccb7f541b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.847405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.848156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.848545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.848899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.849838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.851628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.867620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 878/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:40.868707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.880581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6fa-ff1a-46ee-8eaa-1ab85046b966 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.886830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.888066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.888066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.888256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] PATH_INFO: `/v3/projects/8f3d325fdd954a3c9234c1528808f4c8/users/8f1e81ba5dbd430d8d6367a2f22c7f22/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.891143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.898320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.903062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.911136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3d325fdd954a3c9234c1528808f4c8, user_id=8f1e81ba5dbd430d8d6367a2f22c7f22, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.914259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 902/1780] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:40.926142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.961320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 879/1781] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:40 2022] PUT /identity/v3/projects/8f3d325fdd954a3c9234c1528808f4c8/users/8f1e81ba5dbd430d8d6367a2f22c7f22/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:40.965492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.981353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfb76-944d-49f9-9162-2d70cbdd4018 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:41.056532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:41.056532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:41.056532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:41.056532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:41.057034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:41.057034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe728-6b15-43ab-b933-676b1388b869 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:41.067464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 903/1782] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:41.071329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:41.083486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eac28b-a6e6-4ed2-9bb6-f0765c4ad9b8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:41.089992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:41.091109 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:41.091488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:41.091861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] PATH_INFO: `/v3/projects/8f3d325fdd954a3c9234c1528808f4c8/users/8f1e81ba5dbd430d8d6367a2f22c7f22/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:41.095035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3d325fdd954a3c9234c1528808f4c8, user_id=8f1e81ba5dbd430d8d6367a2f22c7f22, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:41.102594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:41.128240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 880/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:41 2022] PUT /identity/v3/projects/8f3d325fdd954a3c9234c1528808f4c8/users/8f1e81ba5dbd430d8d6367a2f22c7f22/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:41.131701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c814a3-65ea-4481-aa69-1478180f56e8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:41.131978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c814a3-65ea-4481-aa69-1478180f56e8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:41.132315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c814a3-65ea-4481-aa69-1478180f56e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:41.171161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f2c814a3-65ea-4481-aa69-1478180f56e8 None None] MFA Rules not processed for user `8f1e81ba5dbd430d8d6367a2f22c7f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:41.172839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f2c814a3-65ea-4481-aa69-1478180f56e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:41.281464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 904/1784] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:41.429562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:41.485097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1652-52e0-468b-99f7-1b9901c50249 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:41.486788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1652-52e0-468b-99f7-1b9901c50249 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:41.487132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1652-52e0-468b-99f7-1b9901c50249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:41.534957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b20d1652-52e0-468b-99f7-1b9901c50249 None None] MFA Rules not processed for user `833d9bca716f46ec8691918aded091a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:41.536760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b20d1652-52e0-468b-99f7-1b9901c50249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:41.542607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:41.543941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89582e-cabf-409e-ab35-c422b46fd3e7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:41.554052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:41.554805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:41.555164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:41.555536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:41.649340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:41.651320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2aaaf-2f8e-464e-8162-7d8ef6d165b9 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:41.658842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 905/1785] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:41.669974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 881/1786] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:42.609587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.610105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.610190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.611776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 906/1787] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:42.637430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.637926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.638643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.657949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:42.659159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.738933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 882/1788] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:42.785707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.794423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.813427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8cb66-ae8f-46b1-8b69-cae14854eb49 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.818899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.819552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.819836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.820107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.850360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.852581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.878288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 907/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:43.788247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.789785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:43.815869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:43.863022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cda37b-5add-4f2b-b3fa-cd2075d3654e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.867655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.869041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.869771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.869771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] PATH_INFO: `/v3/users/99800bc9c8d94a4686d6051fa018a12f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.870874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99800bc9c8d94a4686d6051fa018a12f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.872780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.939344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99800bc9c8d94a4686d6051fa018a12f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:43.939993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99800bc9c8d94a4686d6051fa018a12f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:43.947762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99800bc9c8d94a4686d6051fa018a12f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:43.955571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99800bc9c8d94a4686d6051fa018a12f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:43.956514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99800bc9c8d94a4686d6051fa018a12f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:43.974822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 883/1790] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:43 2022] DELETE /identity/v3/users/99800bc9c8d94a4686d6051fa018a12f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:44.187063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.201607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf2369-f90a-425b-810b-f44c52b763de service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.291783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:44.292731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.293606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.294231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] PATH_INFO: `/v3/projects/8dabfc42b4904212b6e1012839d699c4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.295683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dabfc42b4904212b6e1012839d699c4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:44.298025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.371742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dabfc42b4904212b6e1012839d699c4', 'request_id': 'req-285e725e-d4e7-45f7-9868-9b566cfb44e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.378698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dabfc42b4904212b6e1012839d699c4', 'request_id': 'req-285e725e-d4e7-45f7-9868-9b566cfb44e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.386264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dabfc42b4904212b6e1012839d699c4', 'request_id': 'req-285e725e-d4e7-45f7-9868-9b566cfb44e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.408357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] The token cache is being invalidate because project 8dabfc42b4904212b6e1012839d699c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:44.408823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.409845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.412398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 908/1791] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:44 2022] DELETE /identity/v3/projects/8dabfc42b4904212b6e1012839d699c4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:44.416440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.418942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:44.437857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d84c9-0f76-4828-9276-5c75a04cb4cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.575581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:44.576486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.576770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.577969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] PATH_INFO: `/v3/users/833d9bca716f46ec8691918aded091a0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.579949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=833d9bca716f46ec8691918aded091a0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:44.584644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.647736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:44.663101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833d9bca716f46ec8691918aded091a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.664549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833d9bca716f46ec8691918aded091a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.677340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833d9bca716f46ec8691918aded091a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.689688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833d9bca716f46ec8691918aded091a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.691452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833d9bca716f46ec8691918aded091a0'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.731887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 884/1792] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:44 2022] DELETE /identity/v3/users/833d9bca716f46ec8691918aded091a0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:44.920326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.930977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:44.948222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e725e-d4e7-45f7-9868-9b566cfb44e0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.977009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:44.977689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.980126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.057925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.059470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.059757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.060040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] PATH_INFO: `/v3/users/83de857b81b14ea69946ab8a31c42d73` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.061870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=83de857b81b14ea69946ab8a31c42d73)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.063818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.099142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197b12-f535-4a96-87d5-906e89cc2a5f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.104782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.105782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.106138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.106496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] PATH_INFO: `/v3/projects/1ee78b0446584d32a0572b0630482f14` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.107831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee78b0446584d32a0572b0630482f14)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.109859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.120095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83de857b81b14ea69946ab8a31c42d73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.120839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83de857b81b14ea69946ab8a31c42d73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.135712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83de857b81b14ea69946ab8a31c42d73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.144060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83de857b81b14ea69946ab8a31c42d73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.151184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6b896b73-a5ec-4755-97d1-a078b4f1bb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83de857b81b14ea69946ab8a31c42d73'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.157428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 909/1793] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:44 2022] DELETE /identity/v3/users/83de857b81b14ea69946ab8a31c42d73 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:45.161668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.161810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee78b0446584d32a0572b0630482f14', 'request_id': 'req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.161959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.162290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.169772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee78b0446584d32a0572b0630482f14', 'request_id': 'req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.175853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee78b0446584d32a0572b0630482f14', 'request_id': 'req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.179847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:45.181801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.187956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] The token cache is being invalidate because project 1ee78b0446584d32a0572b0630482f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:45.188242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.188883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cf2943a-7838-4d90-89d5-8ab1bfc92d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.190655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 885/1794] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:44 2022] DELETE /identity/v3/projects/1ee78b0446584d32a0572b0630482f14 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:45.195392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925cd01-7120-45c4-b07a-37cfcd47cf2f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.195674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925cd01-7120-45c4-b07a-37cfcd47cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.195949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925cd01-7120-45c4-b07a-37cfcd47cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.214754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6925cd01-7120-45c4-b07a-37cfcd47cf2f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:45.216079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6925cd01-7120-45c4-b07a-37cfcd47cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.255923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 910/1795] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:45.267424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.268980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.269848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.293498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 886/1796] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:45.302979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.303344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.303698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.331631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.338293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:45.339586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.345502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bc94a-41e9-4ca2-a4b3-2b4826334555 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.350846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.351681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.352085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 887/1797] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:45.352215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.352520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.353222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.362588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.363543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce759e-09b2-445b-9454-9bb25f71528e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.364028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.369535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.370857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.371358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.371825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.372895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:45.373000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.375840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.376156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 911/1798] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:45.389041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 888/1799] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:45.393982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.404122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde15c6-985c-45a3-a4a2-b192507d29fc service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.409737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.410391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.410669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.411100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.411980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.414074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.441852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 912/1800] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:45.446019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.457499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c563280-8bfa-485f-b557-1a32344b498f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.516044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.516708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.516988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.517259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.517986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.519885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.542381 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 889/1801] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:45.548004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.559177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca969-d4c3-4d25-9fe9-796516c28a38 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.563829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.564494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.564812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.565092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.565888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.567517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.579790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 913/1802] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:45.583817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.596689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f5c4-f688-499b-978a-3436169765c5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.601392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.602068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.602345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.602619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.603475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.605125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.622241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 890/1803] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:45.624534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.639410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea073fd-3807-4fe6-919f-6540f8d5c520 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.644792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.646755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.647031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.647314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] PATH_INFO: `/v3/projects/eef8824631b54fafb4e4c5fafcb6d1fd/users/ea19ff11c3934c5cac57ea27e5bc5c7f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.685555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef8824631b54fafb4e4c5fafcb6d1fd, user_id=ea19ff11c3934c5cac57ea27e5bc5c7f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.689672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405890-d501-4471-ac08-261a69fd3e5b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.707956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 914/1804] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:45 2022] PUT /identity/v3/projects/eef8824631b54fafb4e4c5fafcb6d1fd/users/ea19ff11c3934c5cac57ea27e5bc5c7f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:45.709180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.719208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.727315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.727671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.728056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.763696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380eba0-89f2-427a-b017-2d07db5281f8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.773329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] MFA Rules not processed for user `ea19ff11c3934c5cac57ea27e5bc5c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:45.774671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.849690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.850866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.851213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.851726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] PATH_INFO: `/v3/projects/ebf83c63e6844a0b889056b9a963d42e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.853095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf83c63e6844a0b889056b9a963d42e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.855144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 915/1805] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:45.855270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.859539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.880209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d7eb-2796-48ef-b70a-f58bbb8b933f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.885993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.886785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.887203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.887574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.888322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.890786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.907068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf83c63e6844a0b889056b9a963d42e', 'request_id': 'req-c920d364-66ca-44af-aa2c-42ce18ce55eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.909512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.916967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf83c63e6844a0b889056b9a963d42e', 'request_id': 'req-c920d364-66ca-44af-aa2c-42ce18ce55eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.919805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 916/1806] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:45.923883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.926415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf83c63e6844a0b889056b9a963d42e', 'request_id': 'req-c920d364-66ca-44af-aa2c-42ce18ce55eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.939364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] The token cache is being invalidate because project ebf83c63e6844a0b889056b9a963d42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:45.939650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.940318 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.941915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 891/1807] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:45 2022] DELETE /identity/v3/projects/ebf83c63e6844a0b889056b9a963d42e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:45.946626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.948535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.988039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.001337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aed3-6a0b-424d-bed4-c377ac292952 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.006932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.008328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.008677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.009141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.010181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.012353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.016285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920d364-66ca-44af-aa2c-42ce18ce55eb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.022724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.023836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.023985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.025121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] PATH_INFO: `/v3/users/7e035a356a574b8f93e173eecda09e18` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.027090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e035a356a574b8f93e173eecda09e18)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.029551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.034463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 917/1808] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:46.038416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.040038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.056241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b19b23-72a3-4c7c-b329-33750219117c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.062118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.062825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.063104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.064056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.065432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.069620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.084908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 918/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:46.089680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.101246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d57f8-eb46-4c51-9dab-7da624fb42ab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.104247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e035a356a574b8f93e173eecda09e18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.104934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e035a356a574b8f93e173eecda09e18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.108006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.109160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.109464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.109751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] PATH_INFO: `/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265/users/7f192133215647aea43fbe39aec0e2bb/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.112542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e035a356a574b8f93e173eecda09e18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.122678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e035a356a574b8f93e173eecda09e18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.123785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e035a356a574b8f93e173eecda09e18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.130444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fbed274c1b4dd88f0bcd68f1b16265, user_id=7f192133215647aea43fbe39aec0e2bb, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.132986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.144800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 892/1810] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:45 2022] DELETE /identity/v3/users/7e035a356a574b8f93e173eecda09e18 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:46.147422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 919/1811] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:46 2022] PUT /identity/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265/users/7f192133215647aea43fbe39aec0e2bb/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:46.151682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.153110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.219442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.223805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0306eb-db64-4a2e-8cb2-9da12d88eff4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.231103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.232687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.233326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.233951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.234885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.236848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6c359-6347-424a-bc94-ce12ff1a2991 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.247678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 893/1812] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:46.252050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.325165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e44ca-0dee-44b8-a38a-fac76697359f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.335258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.336269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.336695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.337141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] PATH_INFO: `/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265/users/7f192133215647aea43fbe39aec0e2bb/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.339809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fbed274c1b4dd88f0bcd68f1b16265, user_id=7f192133215647aea43fbe39aec0e2bb, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.343066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.354558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 920/1813] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:46 2022] PUT /identity/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265/users/7f192133215647aea43fbe39aec0e2bb/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:46.364650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.364940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.365219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.392405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] MFA Rules not processed for user `7f192133215647aea43fbe39aec0e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:46.393683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.431627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.433482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.481547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 894/1814] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:46.489771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.493717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.526399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83007-dfa3-4da9-a1f5-cf8461aec763 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.531529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.532504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.532888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.533283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] PATH_INFO: `/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.534621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94141afdad84724bf98aa4cbf5ba3d6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.536574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.568988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff513-c3cb-485d-bfcf-665d54c53ebb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.576177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.576965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.577247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.577662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.583673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.589223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.591866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900c24d-f79e-40c6-8889-643dc0ca4dbc service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.595349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94141afdad84724bf98aa4cbf5ba3d6', 'request_id': 'req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.603353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94141afdad84724bf98aa4cbf5ba3d6', 'request_id': 'req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.603828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 895/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:46.612656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94141afdad84724bf98aa4cbf5ba3d6', 'request_id': 'req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.625917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] The token cache is being invalidate because project c94141afdad84724bf98aa4cbf5ba3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:46.626207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.626853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62fdbd87-62f9-405e-b8dc-d62ccaef76f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.628589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 921/1816] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:46 2022] DELETE /identity/v3/projects/c94141afdad84724bf98aa4cbf5ba3d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:46.633641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.633969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.634802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.654253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:46.655683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.729117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 896/1817] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:46.737924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.738191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.738459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.757302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:46.758529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.767383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 922/1818] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:46.771759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.782253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53acc2-920c-4a1c-8c27-f81301bb2259 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.786929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.787604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.787932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.788151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.788897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:46.789191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.794097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.819136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 897/1819] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:46.826439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.834462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755eebf-6ae6-4c41-a112-5914b09835a8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.840158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.840971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.841326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.841635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.843415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.846174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.878823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 923/1820] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:46.880139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.891736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f7bd-1cba-4919-a1b6-ad012fed1c4e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.897583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.969458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.970770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.971067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.971355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.972058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.974187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.001764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 898/1821] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:47.003852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.017768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dfaa-f4e9-4f93-b753-e0331de4bb83 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.022703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.023372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.023745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.023929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.025237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.027014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.039494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 924/1822] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:47.043614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.058117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5bf93-4bb8-4d39-aa9f-46ca39caffe8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.073349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.073349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.073349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.073349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.073817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.073817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3087b-7161-45e3-b060-7ff4bcae27a3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.079218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 899/1823] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:47.083601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.094720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f370bd-dc4f-4a85-b8da-8abb4d8eb736 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.100291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.101174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.101591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.102188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] PATH_INFO: `/v3/projects/5a0e49327f8e459091f8650f2973da7f/users/6f35468f4a1c45c58ac2f93014be92eb/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.121571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0e49327f8e459091f8650f2973da7f, user_id=6f35468f4a1c45c58ac2f93014be92eb, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.126061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.159215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 925/1824] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:47 2022] PUT /identity/v3/projects/5a0e49327f8e459091f8650f2973da7f/users/6f35468f4a1c45c58ac2f93014be92eb/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:47.170743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7330-4566-468b-a85c-44687c83819e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.172001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7330-4566-468b-a85c-44687c83819e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.172382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7330-4566-468b-a85c-44687c83819e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.209571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0bed7330-4566-468b-a85c-44687c83819e None None] MFA Rules not processed for user `6f35468f4a1c45c58ac2f93014be92eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:47.215193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0bed7330-4566-468b-a85c-44687c83819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:47.307588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 900/1825] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:47.308859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.387456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3433724-9474-4d57-a5ef-f01f878e1f66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.392266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.392929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.393214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.393587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.395175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.397174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.429411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 926/1826] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:47.430648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7330-4566-468b-a85c-44687c83819e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.442085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7330-4566-468b-a85c-44687c83819e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.504704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.505410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.505689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.505972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.506669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.508620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.532084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 901/1827] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:47.535988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.546853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843be738-ab09-491e-9afe-f6d9cf1b7385 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.551510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.552450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.552594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.552870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.553627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.555242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.567250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 927/1828] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:47.571733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.582376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9411a-0914-4a69-af71-d156c61b7868 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.587969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.588836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.589118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.589417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.590149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.591732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044d38-d623-4e6a-83f9-1e5f20276339 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.593424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:47.606834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 902/1829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:47.614861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.626615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bcde1-599b-4045-a804-5d0290b2cf36 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.631304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.632242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.632528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.632800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] PATH_INFO: `/v3/projects/15c236efd30f41e09960dfc5e306bb5f/users/c86fdbca80a848b1b18f1f4e7c7d5e4f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.650980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c236efd30f41e09960dfc5e306bb5f, user_id=c86fdbca80a848b1b18f1f4e7c7d5e4f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.654090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.673180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 928/1830] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:47 2022] PUT /identity/v3/projects/15c236efd30f41e09960dfc5e306bb5f/users/c86fdbca80a848b1b18f1f4e7c7d5e4f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:47.686227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.687646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.687646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.729916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] MFA Rules not processed for user `c86fdbca80a848b1b18f1f4e7c7d5e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:47.731361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:47.813208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 903/1831] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:47.819421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.843966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:47.909786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0dcf-e99d-489f-8e91-d1f9f91baa2f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.915879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.916809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.917247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.917623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.918450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.920509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.946985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 929/1832] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:47.951266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.963370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708683b-f9e0-4a06-9713-099dff771659 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.030775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.031449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.031732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.032013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.032717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.034675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.060321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 904/1833] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:48.061648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.073111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6b0e-bce5-4fb5-9eaa-3aaf0966f39b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.078285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.078986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.079269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.079559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.080261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.081914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.094235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 930/1834] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:48.098656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.112979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd250f2-460d-4eb9-b44e-afe962f71d38 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.117672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.119499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.119897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.120465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] PATH_INFO: `/v3/projects/2b10d7132bbd431e918a54f6df94dbeb/users/cf276c262f3e45459c73b869b3942ee1/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.143502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b10d7132bbd431e918a54f6df94dbeb, user_id=cf276c262f3e45459c73b869b3942ee1, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.149183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.149809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.151210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.167060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 905/1835] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:48 2022] PUT /identity/v3/projects/2b10d7132bbd431e918a54f6df94dbeb/users/cf276c262f3e45459c73b869b3942ee1/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:48.172667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.173586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0b7f-8fce-43e9-8ced-109ac7489443 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.239753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:48.261653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.263121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.265676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.265676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] PATH_INFO: `/v3/users/ea19ff11c3934c5cac57ea27e5bc5c7f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.267110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe767-4f74-4f3b-aac3-59faf2df7982 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.267227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea19ff11c3934c5cac57ea27e5bc5c7f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.269341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.275193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.276406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.276786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.277233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.278672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.280576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.293106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 906/1836] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:48.298539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.311470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91916-ba44-4ec2-8172-b6952fbcaaa3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.321005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.322533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.322816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.323092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] PATH_INFO: `/v3/projects/2b10d7132bbd431e918a54f6df94dbeb/users/cf276c262f3e45459c73b869b3942ee1/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.334509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b10d7132bbd431e918a54f6df94dbeb, user_id=cf276c262f3e45459c73b869b3942ee1, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.336959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149707b-61b8-4c32-a964-1607942fa9da admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.338975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea19ff11c3934c5cac57ea27e5bc5c7f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:48.340139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea19ff11c3934c5cac57ea27e5bc5c7f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:48.348757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 907/1837] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:48 2022] PUT /identity/v3/projects/2b10d7132bbd431e918a54f6df94dbeb/users/cf276c262f3e45459c73b869b3942ee1/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:48.359195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.359489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.359770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.360604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea19ff11c3934c5cac57ea27e5bc5c7f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:48.370991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea19ff11c3934c5cac57ea27e5bc5c7f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:48.382530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2695b9aa-cb4d-4b3f-a0f4-07605e6d878c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea19ff11c3934c5cac57ea27e5bc5c7f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:48.397478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 931/1838] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:48 2022] DELETE /identity/v3/users/ea19ff11c3934c5cac57ea27e5bc5c7f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:48.399120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.399413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.399754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.407045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] MFA Rules not processed for user `cf276c262f3e45459c73b869b3942ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:48.408554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.429124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:48.432254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.437714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:48.510180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 908/1839] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:48.522242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.522888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 932/1840] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:48.524245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.532918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.534372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.597768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e1cd-5efb-4dbd-96bd-0134acfb5218 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.600807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2c88-95e0-448c-b19c-b1ca2b7f88ec None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.601365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.602139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.602421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.602811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.604581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.605229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.605675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.605959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.612255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.613726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.615460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.616892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.625523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 933/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:48.627374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 909/1842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:48.668622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.670076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.682148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0860-64c0-4799-9011-51aba0125783 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.686333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.687001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.687277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.687550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.689335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.758797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.761138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.770490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 934/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:49.058891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:49.061445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:49.081332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad962446-559f-4dd0-be01-82f777a8b656 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:49.089077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:49.090948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.091429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.091892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] PATH_INFO: `/v3/projects/eef8824631b54fafb4e4c5fafcb6d1fd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:49.093479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef8824631b54fafb4e4c5fafcb6d1fd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:49.095637 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:49.152102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef8824631b54fafb4e4c5fafcb6d1fd', 'request_id': 'req-236ff136-99e2-4a07-9904-bbc6fafe5af7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.161607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef8824631b54fafb4e4c5fafcb6d1fd', 'request_id': 'req-236ff136-99e2-4a07-9904-bbc6fafe5af7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.168906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef8824631b54fafb4e4c5fafcb6d1fd', 'request_id': 'req-236ff136-99e2-4a07-9904-bbc6fafe5af7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.177102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:49.198008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] The token cache is being invalidate because project eef8824631b54fafb4e4c5fafcb6d1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:49.198301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.199091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.200810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 910/1844] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:49 2022] DELETE /identity/v3/projects/eef8824631b54fafb4e4c5fafcb6d1fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:49.205003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:49.225436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf44f-b763-46bf-ae21-2b0bbe5598ae service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:49.362061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:49.378419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:49.379500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.379970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.380409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] PATH_INFO: `/v3/users/7f192133215647aea43fbe39aec0e2bb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:49.381868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f192133215647aea43fbe39aec0e2bb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:49.384073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:49.459970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f192133215647aea43fbe39aec0e2bb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.461283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f192133215647aea43fbe39aec0e2bb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.486245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f192133215647aea43fbe39aec0e2bb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.498975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f192133215647aea43fbe39aec0e2bb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.511080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c43fd4fa-3b04-4e40-a03f-9f8aa51cbe38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f192133215647aea43fbe39aec0e2bb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:49.522684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 935/1845] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:49 2022] DELETE /identity/v3/users/7f192133215647aea43fbe39aec0e2bb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:49.955951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:49.957573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:49.971552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ff136-99e2-4a07-9904-bbc6fafe5af7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.035500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.036396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.036789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.037269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] PATH_INFO: `/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.038689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fbed274c1b4dd88f0bcd68f1b16265)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.040770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.099817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fbed274c1b4dd88f0bcd68f1b16265', 'request_id': 'req-94db736a-e843-4d03-bbae-08486bc45cb7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:50.115377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fbed274c1b4dd88f0bcd68f1b16265', 'request_id': 'req-94db736a-e843-4d03-bbae-08486bc45cb7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:50.125417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fbed274c1b4dd88f0bcd68f1b16265', 'request_id': 'req-94db736a-e843-4d03-bbae-08486bc45cb7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:50.145412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] The token cache is being invalidate because project 45fbed274c1b4dd88f0bcd68f1b16265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:50.145412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:50.145412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94db736a-e843-4d03-bbae-08486bc45cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:50.145412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 911/1846] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:49 2022] DELETE /identity/v3/projects/45fbed274c1b4dd88f0bcd68f1b16265 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:50.151859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.152259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.152635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.175197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:50.176543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:50.241869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 936/1847] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:50.249679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.249966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.250244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.271085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:50.272292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:50.281037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 912/1848] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:50.285191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.295223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76f3a-b6da-4179-aa48-7cc58708728f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.299988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.300638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.300919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.301196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.301950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:50.302253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.303874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.316581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 937/1849] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:50.320512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.331518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d02c3-141d-4c47-9bb3-224601068f35 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.336275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.337645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.338037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.338496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.339201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.341097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.366137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 913/1850] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:50.370941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.380948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bbf6-0a8b-474f-bc82-546d29097760 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.430527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:50.437683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.438477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.438951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.439439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.440711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.442765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.462529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 938/1851] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:50.466823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.476907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5c8f-6465-4128-bd46-f370e2c5b3bd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.481563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.482210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.482488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.482761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.483479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.485067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.495829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 914/1852] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:50.499809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.510900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988587-c3e8-417d-80b5-0f987995f483 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.515578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.516224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.516615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.516899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.517656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.519286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabd9f-0122-44bf-8aaf-fad13df6a805 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.531367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 939/1853] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:50.535774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.545961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd4837-3967-4b86-857d-f1da26e9f08e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.550632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.551535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.551821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.552153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] PATH_INFO: `/v3/projects/8050bbd8303642129b0ea1cb70fc8369/users/e7ad722cb08a4f0f91c0883409de5322/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.567004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8050bbd8303642129b0ea1cb70fc8369, user_id=e7ad722cb08a4f0f91c0883409de5322, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.569724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.583598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 915/1854] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:50 2022] PUT /identity/v3/projects/8050bbd8303642129b0ea1cb70fc8369/users/e7ad722cb08a4f0f91c0883409de5322/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:50.594707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.595102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.595451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.746009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] MFA Rules not processed for user `e7ad722cb08a4f0f91c0883409de5322`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:50.747266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:50.813887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 940/1855] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:50.818330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.831418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:50.887319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bb15-1fcc-418f-882e-3c2cb15ca837 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:50.892579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:50.893315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:50.893695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:50.894060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.894839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.897157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.926046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 916/1856] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:50.930481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:50.947184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a3676-a64c-4d5c-8554-ed70df3c4d09 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.004593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.005257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.005571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.005843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.006530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.008426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.028116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 941/1857] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:50 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:51.032311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.043014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9be6-4e05-48e1-9005-111b7561ab24 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.047640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.048319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.048603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.048880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.049635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.051225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.061669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 917/1858] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:51.065676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.076042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec7c9-ef2a-4391-8377-7886cf6f390a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.080606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.081243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.081554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.081829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.082543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.084129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df444c-c716-4a46-a688-08774f8e5fb1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.094368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 942/1859] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:51.098328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.108148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e92553-594b-48be-a29e-e38babae90fe admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.112778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.113674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.113955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.114234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] PATH_INFO: `/v3/projects/28c2edb357a5473d88bb3a1c35a0d4df/users/0025c20e47c5463888fa65fa7ddb9377/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.129498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c2edb357a5473d88bb3a1c35a0d4df, user_id=0025c20e47c5463888fa65fa7ddb9377, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.132494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.146220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 918/1860] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:51 2022] PUT /identity/v3/projects/28c2edb357a5473d88bb3a1c35a0d4df/users/0025c20e47c5463888fa65fa7ddb9377/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:51.157671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.158017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.158332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.184856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] MFA Rules not processed for user `0025c20e47c5463888fa65fa7ddb9377`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:51.186126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:51.218328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:51.253415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 943/1861] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:51.257916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.335938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f593b-9c04-452c-b59f-bbbb9ed007e2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.346632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.347296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.347579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.347875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.348664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.350618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.379913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 919/1862] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:51.381078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.392324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40435938-417d-42e2-a37c-9c6fe0246ca7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.448533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.449198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.449508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.449782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.450465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.452374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.471501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 944/1863] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:51 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:51.475625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.486467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6b06-8553-42c4-bc20-6c1196675b22 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.491056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.491703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.491983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.492258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.492974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.495225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.505585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 920/1864] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:51.509769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.519616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e02752-af4b-40b5-aefa-d251e1dc0a0d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.524456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.525310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.525627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.525906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] PATH_INFO: `/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8/users/f2f7733809494906981382736f409c6d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.541008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54244e2e4ddb41878ddcd5aaf112e0b8, user_id=f2f7733809494906981382736f409c6d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.543676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.556576 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 945/1865] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:51 2022] PUT /identity/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8/users/f2f7733809494906981382736f409c6d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:51.560601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.570638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e23c-2b07-4b95-8406-c72136e4fbab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.603489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:51.628981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.629678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.629978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.630242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.630965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.632554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9df49-7a2e-4179-b234-d42740f05342 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.642563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 921/1866] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:51.646823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.656965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398972e-161f-4fbe-b6ab-6a18a08e571e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.661549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.662429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.662693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.662980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] PATH_INFO: `/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8/users/f2f7733809494906981382736f409c6d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.664919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54244e2e4ddb41878ddcd5aaf112e0b8, user_id=f2f7733809494906981382736f409c6d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.668232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.678648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 946/1867] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:51 2022] PUT /identity/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8/users/f2f7733809494906981382736f409c6d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:51.689262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.689589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.689900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.717028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] MFA Rules not processed for user `f2f7733809494906981382736f409c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:51.718404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:51.787342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 922/1868] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:51.798951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.800629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:51.863049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde88b0-69ae-4ebd-97bb-8ef52b693ea2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.867211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.867982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.868850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.869267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.879724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.881427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e734e3-e125-4cb0-9528-8abe08cbe067 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.893268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 947/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:52.451958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:52.453425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:52.465498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9cc5f-2218-4368-8992-8f9209cdb675 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:52.469071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:52.469756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:52.470044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:52.470326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:52.532368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:52.534094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a97f97-c0a6-450c-8e9a-7c25d7b8700a service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:52.543843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 923/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:54.724057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:54.724693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:54.724693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:54.726195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 948/1871] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:54.735639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:54.736115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:54.736448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:54.756346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:54.757585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:54.813495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:54.833657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 924/1872] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:54.846600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:54.848325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:54.866105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a57f-31ff-418a-a589-9aa05bd15965 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:54.872509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:54.873151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:54.873453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:54.873734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:54.883510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:54.886152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:54.900361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 949/1873] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:55.352239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:55.363154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93df2-b6ac-4fcd-bb2f-222a645429cb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:55.366992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:55.367640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:55.367925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:55.368784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:55.370639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:55.451596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:55.454687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293ec37-c22a-4173-a77d-20579f609d2f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:55.483641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 925/1874] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:58.163540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:58.165613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:58.188574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:58.252229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88aa3-7cdd-4a05-a617-89fdfabf431a service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:58.258210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:58.259173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.259455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.259721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] PATH_INFO: `/v3/users/6f35468f4a1c45c58ac2f93014be92eb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.261114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f35468f4a1c45c58ac2f93014be92eb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:58.263596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:58.349692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f35468f4a1c45c58ac2f93014be92eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:58.350809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f35468f4a1c45c58ac2f93014be92eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:58.383036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f35468f4a1c45c58ac2f93014be92eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:58.400536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f35468f4a1c45c58ac2f93014be92eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:58.410934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f35468f4a1c45c58ac2f93014be92eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:58.437603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 950/1875] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:58 2022] DELETE /identity/v3/users/6f35468f4a1c45c58ac2f93014be92eb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:58.437830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.438310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.438403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.473548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:58.473548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:58.577103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 926/1876] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:58.587655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:58.589169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:58.652606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de0-51a2-4c08-915f-2f33068c5860 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:58.656333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:58.656968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.657256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.657579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.670361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:58.673665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:58.691477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 951/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:59.097049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:59.098490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:59.112844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442c486-07e7-4e66-bb70-07610360af4d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:59.119977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:59.122451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:59.122854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:59.123279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] PATH_INFO: `/v3/projects/5a0e49327f8e459091f8650f2973da7f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:59.124788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0e49327f8e459091f8650f2973da7f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:59.127325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:59.198293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0e49327f8e459091f8650f2973da7f', 'request_id': 'req-0fe4e6e7-d993-4837-b186-2603d1ba932d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.213092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0e49327f8e459091f8650f2973da7f', 'request_id': 'req-0fe4e6e7-d993-4837-b186-2603d1ba932d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.219943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0e49327f8e459091f8650f2973da7f', 'request_id': 'req-0fe4e6e7-d993-4837-b186-2603d1ba932d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.234454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] The token cache is being invalidate because project 5a0e49327f8e459091f8650f2973da7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:59.234750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.235566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.237580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 927/1878] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:59 2022] DELETE /identity/v3/projects/5a0e49327f8e459091f8650f2973da7f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:59.241212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:59.251885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b9e7-521c-44fe-bd40-15c8f45b1043 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:59.295536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:59.333271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:59.333785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:59.334064 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:59.334339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] PATH_INFO: `/v3/users/c86fdbca80a848b1b18f1f4e7c7d5e4f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:59.335520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86fdbca80a848b1b18f1f4e7c7d5e4f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:59.338542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:59.398137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86fdbca80a848b1b18f1f4e7c7d5e4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.398832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86fdbca80a848b1b18f1f4e7c7d5e4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.414702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86fdbca80a848b1b18f1f4e7c7d5e4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.423916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86fdbca80a848b1b18f1f4e7c7d5e4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.434705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86fdbca80a848b1b18f1f4e7c7d5e4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.450621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 952/1879] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:59 2022] DELETE /identity/v3/users/c86fdbca80a848b1b18f1f4e7c7d5e4f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:59.759083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:59.760524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:59.771523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:59.775750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e6e7-d993-4837-b186-2603d1ba932d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:59.836246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:59.837286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:59.837644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:59.837933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] PATH_INFO: `/v3/projects/15c236efd30f41e09960dfc5e306bb5f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:59.839130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c236efd30f41e09960dfc5e306bb5f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:59.841031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:59.893563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c236efd30f41e09960dfc5e306bb5f', 'request_id': 'req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.902116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c236efd30f41e09960dfc5e306bb5f', 'request_id': 'req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.908125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c236efd30f41e09960dfc5e306bb5f', 'request_id': 'req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.920193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] The token cache is being invalidate because project 15c236efd30f41e09960dfc5e306bb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:59.920486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.921124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:59.922915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 928/1880] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:59 2022] DELETE /identity/v3/projects/15c236efd30f41e09960dfc5e306bb5f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:59.926861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:59.928356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:59.942251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3744-8b89-4967-b0f7-b35ce3a8de3a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:00.013353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:00.014584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:00.014931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:00.015272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] PATH_INFO: `/v3/users/cf276c262f3e45459c73b869b3942ee1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:00.016679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf276c262f3e45459c73b869b3942ee1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:00.019478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:00.129305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf276c262f3e45459c73b869b3942ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:00.130385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf276c262f3e45459c73b869b3942ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:00.158113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:00.169240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf276c262f3e45459c73b869b3942ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:00.189362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf276c262f3e45459c73b869b3942ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:00.206147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf276c262f3e45459c73b869b3942ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:00.229636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 953/1881] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:59 2022] DELETE /identity/v3/users/cf276c262f3e45459c73b869b3942ee1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:00.249791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:00.251550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:00.403542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77602-0c0b-4444-a1eb-bf6fa6c07f37 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:00.488030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:00.489526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:00.489811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:00.490423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:00.493523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:00.510302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:00.671531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:00.675143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801814-8561-42e8-90b7-9fae3def9b2b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:00.726791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 929/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:00.976474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:00.980460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:01.103849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f3b1-d26e-47a1-8886-fb0396895dde admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.115993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.117024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.117474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.118737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] PATH_INFO: `/v3/projects/2b10d7132bbd431e918a54f6df94dbeb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.120869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b10d7132bbd431e918a54f6df94dbeb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.123113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.186367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b10d7132bbd431e918a54f6df94dbeb', 'request_id': 'req-969d3941-d6ab-4e6a-a62d-e3d217e476cf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:01.194475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b10d7132bbd431e918a54f6df94dbeb', 'request_id': 'req-969d3941-d6ab-4e6a-a62d-e3d217e476cf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:01.202261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b10d7132bbd431e918a54f6df94dbeb', 'request_id': 'req-969d3941-d6ab-4e6a-a62d-e3d217e476cf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:01.218636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] The token cache is being invalidate because project 2b10d7132bbd431e918a54f6df94dbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:01.218976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:01.219920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-969d3941-d6ab-4e6a-a62d-e3d217e476cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:01.222267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 954/1883] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:00 2022] DELETE /identity/v3/projects/2b10d7132bbd431e918a54f6df94dbeb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:01.229705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.230183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.230522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.253983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:01.255195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:01.320223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 930/1884] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:01.336329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.338842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.339354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.373004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:01.374417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:01.387191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 955/1885] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:01.388417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.398657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006acb7-bf40-4262-bd75-0f0a8d0d9746 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.409798 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.410486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.410924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.411221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.412359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:01.412660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.414474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.429301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 931/1886] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:12:01.434674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.444106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941cad9-4a47-4021-9836-f1ee04e8d607 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.449911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.450641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.450927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.451206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.451977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.454027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.482267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 956/1887] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:01 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:01.486354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.498520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fcb6-2a97-4a0d-9fda-0ea836e7bc3e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.560244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.561009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.561132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.561442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.562152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.564081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.587660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 932/1888] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:01 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:01.591937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.603739 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c115-5005-457e-8f92-32ddd2be3b93 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.613935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.614612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.614897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.615178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.615905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.617836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.629176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 957/1889] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:01.633614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.645042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37adaf7-451b-44c7-907a-c48d5f7a63ab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.651116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.651840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.652092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.652398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.653091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.654819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc4aa-507d-4d9f-a4ff-246506a0699c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.669485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 933/1890] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:01.670717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.687165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bcf8d-6041-4756-a730-87d68c40e268 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.693930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.694989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.695430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.695960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] PATH_INFO: `/v3/projects/ebc1449acac74d04bbd1a688ad767269/users/fe754e741cde411993c39cab50e32f35/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.713013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc1449acac74d04bbd1a688ad767269, user_id=fe754e741cde411993c39cab50e32f35, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:01.716338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:01.736823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 958/1891] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:01 2022] PUT /identity/v3/projects/ebc1449acac74d04bbd1a688ad767269/users/fe754e741cde411993c39cab50e32f35/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:01.751992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.752392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.752617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:01.793268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:01.809461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] MFA Rules not processed for user `fe754e741cde411993c39cab50e32f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:01.811624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:01.893135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 934/1892] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:01.906376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:01.908298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:01.913785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:01.986505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ec38-b2c3-4e1b-afd1-90038baf56d3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:01.991240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:01.991895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:01.992210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:01.992487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.002487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:02.003960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0bd09-7e0f-4835-8e07-6b0b9ee4e3f3 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:02.015630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 959/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:02.250534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:02.252722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:02.355848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b759b-f6c5-40fd-9305-209956ea761d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:02.357246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:02.358246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:02.358595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:02.358964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] PATH_INFO: `/v3/users/d0e62085a945478db4a00369214594e9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.360313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e62085a945478db4a00369214594e9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:02.362566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:02.415869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e62085a945478db4a00369214594e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.416590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e62085a945478db4a00369214594e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.424860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e62085a945478db4a00369214594e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.439800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e62085a945478db4a00369214594e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.440516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e62085a945478db4a00369214594e9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.465688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 935/1894] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:02 2022] DELETE /identity/v3/users/d0e62085a945478db4a00369214594e9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:02.470703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:02.470994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:02.471269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.495019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:02.502281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:02.601918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 960/1895] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:02.611407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:02.613130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:02.638474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:02.724477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78affa23-2b8b-4636-b722-b145ed2a00ac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:02.735950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:02.736894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:02.737517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:02.738172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.750778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:02.752565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7464886-1934-4200-ac13-b0c0bc5e105d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:02.768315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 936/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:02.768878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:02.770300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:02.782458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd00915-40cc-40dc-972e-c0c4e35ad52d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:02.787156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:02.788063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:02.788342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:02.788615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] PATH_INFO: `/v3/users/8da31fda780542e6b21e19f3445d3aac` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.790477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da31fda780542e6b21e19f3445d3aac)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:02.792425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:02.857911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da31fda780542e6b21e19f3445d3aac'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.859144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da31fda780542e6b21e19f3445d3aac'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.878574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da31fda780542e6b21e19f3445d3aac'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.887051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da31fda780542e6b21e19f3445d3aac'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.909820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da31fda780542e6b21e19f3445d3aac'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:02.918559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 961/1897] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:02 2022] DELETE /identity/v3/users/8da31fda780542e6b21e19f3445d3aac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:02.923313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:02.923958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:02.924504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:02.957123 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:02.962669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:03.043846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 937/1898] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:03.057061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:03.059125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:03.083376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:03.139584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6cd5c-1944-47aa-9674-d105a4a0d903 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:03.144353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:03.145107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:03.145774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:03.146124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:03.156292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:03.157781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:03.168503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 962/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:03.550195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:03.552559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:03.580434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73d27-9e45-4e6b-af57-e3f307d01903 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:03.597541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:03.598758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:03.599753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:03.600372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] PATH_INFO: `/v3/projects/f92e56af8309465a9fd1375d92fb590d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:03.604036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92e56af8309465a9fd1375d92fb590d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:03.607611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:03.709908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92e56af8309465a9fd1375d92fb590d', 'request_id': 'req-e0982906-d2dd-4cae-8c25-a3191766ce9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.728978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92e56af8309465a9fd1375d92fb590d', 'request_id': 'req-e0982906-d2dd-4cae-8c25-a3191766ce9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.745491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92e56af8309465a9fd1375d92fb590d', 'request_id': 'req-e0982906-d2dd-4cae-8c25-a3191766ce9e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.772716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] The token cache is being invalidate because project f92e56af8309465a9fd1375d92fb590d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:03.773060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.775293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.777525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 938/1900] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:03 2022] DELETE /identity/v3/projects/f92e56af8309465a9fd1375d92fb590d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:03.782223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:03.794847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c212d8-7079-453b-9b78-d57581e5b684 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:03.880755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:03.882674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:03.928562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:03.929661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:03.931034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:03.931034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] PATH_INFO: `/v3/users/8f1e81ba5dbd430d8d6367a2f22c7f22` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:03.933230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1e81ba5dbd430d8d6367a2f22c7f22)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:03.935314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:03.949319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:03.967998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982906-d2dd-4cae-8c25-a3191766ce9e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:03.972846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:03.973850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:03.974151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:03.974529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] PATH_INFO: `/v3/projects/507ae14995f0429a8239d0d0f6f08245` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:03.975736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507ae14995f0429a8239d0d0f6f08245)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:03.977765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:03.986646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1e81ba5dbd430d8d6367a2f22c7f22'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:03.987380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1e81ba5dbd430d8d6367a2f22c7f22'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.003470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1e81ba5dbd430d8d6367a2f22c7f22'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.013995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1e81ba5dbd430d8d6367a2f22c7f22'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.023877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1e81ba5dbd430d8d6367a2f22c7f22'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.032329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 963/1901] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:03 2022] DELETE /identity/v3/users/8f1e81ba5dbd430d8d6367a2f22c7f22 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:04.033467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.034629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.040370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507ae14995f0429a8239d0d0f6f08245', 'request_id': 'req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.048125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507ae14995f0429a8239d0d0f6f08245', 'request_id': 'req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.057741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507ae14995f0429a8239d0d0f6f08245', 'request_id': 'req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.069925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] The token cache is being invalidate because project 507ae14995f0429a8239d0d0f6f08245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:04.070315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.072424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.077709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 939/1902] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:03 2022] DELETE /identity/v3/projects/507ae14995f0429a8239d0d0f6f08245 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:04.078846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.080311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.096411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:04.121662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04b6a8-9d45-4648-86da-cf6cdd361a8c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.126575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:04.127561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.127853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.128296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] PATH_INFO: `/v3/users/e7ad722cb08a4f0f91c0883409de5322` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.130026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ad722cb08a4f0f91c0883409de5322)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:04.132048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:04.162362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbce0c-bf13-4338-96f4-d2d47ab45cf7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.168890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:04.169950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.170301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.170580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] PATH_INFO: `/v3/users/b2d7d412c8cf49b08d1be776eedc5813` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.171901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d7d412c8cf49b08d1be776eedc5813)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:04.173920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:04.189304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ad722cb08a4f0f91c0883409de5322'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.190274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ad722cb08a4f0f91c0883409de5322'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.207903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ad722cb08a4f0f91c0883409de5322'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.217118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ad722cb08a4f0f91c0883409de5322'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.230478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d01e4dfa-5692-42db-a946-1aa5eb1c5aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ad722cb08a4f0f91c0883409de5322'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.240776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 964/1903] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:04 2022] DELETE /identity/v3/users/e7ad722cb08a4f0f91c0883409de5322 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:04.242464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.243229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.243724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.257308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d7d412c8cf49b08d1be776eedc5813'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.259615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d7d412c8cf49b08d1be776eedc5813'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.265184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:04.267100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.267809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d7d412c8cf49b08d1be776eedc5813'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.279599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d7d412c8cf49b08d1be776eedc5813'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.280674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d7d412c8cf49b08d1be776eedc5813'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.296690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:04.310598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 940/1904] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:04 2022] DELETE /identity/v3/users/b2d7d412c8cf49b08d1be776eedc5813 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:04.357016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 965/1905] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:04.368587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.370177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.432747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.434434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.453965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de104a-0b4f-4d2e-b59c-ce363373e713 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.458746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:04.459557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.459911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.460259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.471118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6747-438c-4fd2-96e4-2b90faef6e16 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.559842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:04.561755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31af2e-de83-4e1a-9c36-95d3b1dcf9ff service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:04.568820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:04.569846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.570208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.570556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] PATH_INFO: `/v3/projects/8f3d325fdd954a3c9234c1528808f4c8` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.573445 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3d325fdd954a3c9234c1528808f4c8)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:04.575169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 941/1906] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:04.576038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:04.577988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:04.640120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3d325fdd954a3c9234c1528808f4c8', 'request_id': 'req-ab59929d-fef0-4601-ac7d-00e291c17e79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.648570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3d325fdd954a3c9234c1528808f4c8', 'request_id': 'req-ab59929d-fef0-4601-ac7d-00e291c17e79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.657399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3d325fdd954a3c9234c1528808f4c8', 'request_id': 'req-ab59929d-fef0-4601-ac7d-00e291c17e79'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.670875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] The token cache is being invalidate because project 8f3d325fdd954a3c9234c1528808f4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:04.671215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.671865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.673666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 966/1907] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:04 2022] DELETE /identity/v3/projects/8f3d325fdd954a3c9234c1528808f4c8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:04.679434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f85ed-3c2d-4a17-8f74-34e31d45f6a3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.679722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f85ed-3c2d-4a17-8f74-34e31d45f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.679994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f85ed-3c2d-4a17-8f74-34e31d45f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.701024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a1f85ed-3c2d-4a17-8f74-34e31d45f6a3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:04.702494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a1f85ed-3c2d-4a17-8f74-34e31d45f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.732502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.734096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.811449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59929d-fef0-4601-ac7d-00e291c17e79 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.819325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 942/1908] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:04.826549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:04.827334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.827644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.827937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.828101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.828502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.828808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] PATH_INFO: `/v3/projects/4f0b361a20a249e39cee382c6b21696d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.830247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0b361a20a249e39cee382c6b21696d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:04.832294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:04.871929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:04.874843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:04.890003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 943/1909] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:04.892377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:04.917610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa69012-f3ec-4606-9b21-db7688b8d25f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:04.929211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0b361a20a249e39cee382c6b21696d', 'request_id': 'req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.940114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0b361a20a249e39cee382c6b21696d', 'request_id': 'req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.950137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0b361a20a249e39cee382c6b21696d', 'request_id': 'req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.969313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] The token cache is being invalidate because project 4f0b361a20a249e39cee382c6b21696d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:04.969681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.970355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-94c4ebd1-e8d1-4302-a9e0-770e0ee12b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:04.971999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 967/1910] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:04 2022] DELETE /identity/v3/projects/4f0b361a20a249e39cee382c6b21696d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:04.977785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:04.978115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:04.978348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:04.998220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.008839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:05.010627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.030461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.031006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.031181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.031468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.038587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.039391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:05.039782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.042302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.069247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 944/1911] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:05.070593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.073706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.089632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607af7f-5aff-4bc3-aa7e-4f46cbe5d642 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.093068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 968/1912] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:05.094873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.096402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.099914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.100929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.101340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.101795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] PATH_INFO: `/v3/projects/8050bbd8303642129b0ea1cb70fc8369` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.103642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8050bbd8303642129b0ea1cb70fc8369)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.105794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.111911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffbb59-4804-4c2b-b689-1c158c044d11 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.121074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.121900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.122184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.122454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.123145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.125466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16284fbf-dc6f-4125-a969-ed6857ec7847 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.160569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8050bbd8303642129b0ea1cb70fc8369', 'request_id': 'req-1e0c8161-9d49-4e17-8595-f28b56ce39e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.160894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 969/1913] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:05.162287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.162574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.162854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.172718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8050bbd8303642129b0ea1cb70fc8369', 'request_id': 'req-1e0c8161-9d49-4e17-8595-f28b56ce39e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.179340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8050bbd8303642129b0ea1cb70fc8369', 'request_id': 'req-1e0c8161-9d49-4e17-8595-f28b56ce39e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.186915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:05.188339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.194516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] The token cache is being invalidate because project 8050bbd8303642129b0ea1cb70fc8369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:05.194821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.196541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.201369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 945/1914] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:05 2022] DELETE /identity/v3/projects/8050bbd8303642129b0ea1cb70fc8369 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:05.202234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.203672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.268048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 970/1915] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:05.269182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.272554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.277656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c8161-9d49-4e17-8595-f28b56ce39e4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.286001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835808b-277f-4b86-b3f6-a6e962240e95 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.286196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.286829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.287221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.287508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.288342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.290951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.291345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.292208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.292493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.292765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] PATH_INFO: `/v3/users/0025c20e47c5463888fa65fa7ddb9377` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.293981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0025c20e47c5463888fa65fa7ddb9377)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.295923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.323894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 946/1916] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:05.323894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.339585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99749bd5-f973-4d36-80ac-3f34df58cf9b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.344877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.345605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.345891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.346170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.346901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:05.347228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.348846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.361327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0025c20e47c5463888fa65fa7ddb9377'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.362186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0025c20e47c5463888fa65fa7ddb9377'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.364664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 947/1917] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:05.368461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.378989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0025c20e47c5463888fa65fa7ddb9377'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.380822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977867-ed48-4e40-8193-358631b36104 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.386685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.386823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0025c20e47c5463888fa65fa7ddb9377'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.387400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.387685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.387960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.388722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.390419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.394266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0025c20e47c5463888fa65fa7ddb9377'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:05.400961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 971/1918] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:05 2022] DELETE /identity/v3/users/0025c20e47c5463888fa65fa7ddb9377 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:05.401760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.404687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 948/1919] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:05.404936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.405801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.407555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.423810 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8b5ad-84c9-4749-856c-dd4f0ccf0104 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.424531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.445110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.502287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.503095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.503476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.503779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.504650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.505625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f0fc-1c3c-4bd9-9238-d06f41b3e605 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.506350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.513100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.513637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.513969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.514250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.514897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.516798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.518467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 949/1920] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:05.523860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.537531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452c3f-7d65-4707-be86-a1f033a85f03 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.544286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.545239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.545723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.546068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] PATH_INFO: `/v3/projects/4b265a07c90a4133ace36f0294709c5a/users/e458e09eb7444b39a071082d3144db4e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.549871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 972/1921] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:05.553748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.565980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b265a07c90a4133ace36f0294709c5a, user_id=e458e09eb7444b39a071082d3144db4e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.568887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1272723-4818-4290-9488-a1af5a4f2b56 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.589455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 950/1922] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:05 2022] PUT /identity/v3/projects/4b265a07c90a4133ace36f0294709c5a/users/e458e09eb7444b39a071082d3144db4e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:05.603154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.603587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.604730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.631929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ddfdc-e0cd-4069-8801-e43cae6d8724 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.635258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] MFA Rules not processed for user `e458e09eb7444b39a071082d3144db4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:05.643516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.724432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.724826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.725033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.725514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.726376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.729814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.748445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 951/1923] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:05.760449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.762879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.766847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 973/1924] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:05 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:05.770400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.783087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19463c9-c367-4f56-97c7-b1bc569d802b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.790584 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086342d-62af-4019-b38c-11602201209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.791467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086342d-62af-4019-b38c-11602201209d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.791833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086342d-62af-4019-b38c-11602201209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.793044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086342d-62af-4019-b38c-11602201209d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.793894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086342d-62af-4019-b38c-11602201209d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.796244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086342d-62af-4019-b38c-11602201209d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.808235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 974/1925] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:05.812122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086342d-62af-4019-b38c-11602201209d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.822757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086342d-62af-4019-b38c-11602201209d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.829907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.830596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.830877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.831153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.831874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.833525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.849853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a4907-62a5-401d-80dd-9770b369fbda None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.856642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 975/1926] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:05.859171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.859833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.860113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.860396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.861225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.877348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59913b5-194b-4056-8530-570a9af588b5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.882434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:05.883400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:05.884018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:05.884130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] PATH_INFO: `/v3/projects/8c294a6982374acd8d74e252b1c2b3f5/users/9d7c73f7827a40e68f5dabdeeb0f4ec4/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:05.888910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.892270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.893119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.906145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c294a6982374acd8d74e252b1c2b3f5, user_id=9d7c73f7827a40e68f5dabdeeb0f4ec4, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:05.907900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 952/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:05.908888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:05.910333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.911744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:05.925092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 976/1928] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:05 2022] PUT /identity/v3/projects/8c294a6982374acd8d74e252b1c2b3f5/users/9d7c73f7827a40e68f5dabdeeb0f4ec4/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:05.929652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa090bf-ffe1-42d2-b938-3eec2a3c283f service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:05.935055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:05.955963 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.002388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.003262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.003542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.003818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] PATH_INFO: `/v3/projects/28c2edb357a5473d88bb3a1c35a0d4df` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.004996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c2edb357a5473d88bb3a1c35a0d4df)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.006937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.012573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d982-c2e3-456f-b91a-f0f924f32a06 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.018079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.018972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.019244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.019525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] PATH_INFO: `/v3/users/e458e09eb7444b39a071082d3144db4e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.021010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e458e09eb7444b39a071082d3144db4e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.022973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.057117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c2edb357a5473d88bb3a1c35a0d4df', 'request_id': 'req-aa05139c-a38c-4a39-bfc9-3e88f66f8660'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.065052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c2edb357a5473d88bb3a1c35a0d4df', 'request_id': 'req-aa05139c-a38c-4a39-bfc9-3e88f66f8660'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.071472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c2edb357a5473d88bb3a1c35a0d4df', 'request_id': 'req-aa05139c-a38c-4a39-bfc9-3e88f66f8660'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.073772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e458e09eb7444b39a071082d3144db4e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.074449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e458e09eb7444b39a071082d3144db4e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.082747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] The token cache is being invalidate because project 28c2edb357a5473d88bb3a1c35a0d4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:06.083013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.083665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa05139c-a38c-4a39-bfc9-3e88f66f8660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.085236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 953/1929] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:05 2022] DELETE /identity/v3/projects/28c2edb357a5473d88bb3a1c35a0d4df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:06.086666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35da95-ae61-4940-9555-81ff30b7bcdf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.087066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35da95-ae61-4940-9555-81ff30b7bcdf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.087171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e458e09eb7444b39a071082d3144db4e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.087411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35da95-ae61-4940-9555-81ff30b7bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.093968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e458e09eb7444b39a071082d3144db4e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.101606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e458e09eb7444b39a071082d3144db4e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.107770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 977/1930] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:05 2022] DELETE /identity/v3/users/e458e09eb7444b39a071082d3144db4e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:06.108553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.109903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.116066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9e35da95-ae61-4940-9555-81ff30b7bcdf None None] MFA Rules not processed for user `9d7c73f7827a40e68f5dabdeeb0f4ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:06.117244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e35da95-ae61-4940-9555-81ff30b7bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.177084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5c321-d7ac-4f4d-9a5a-95c4ffe97b71 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.182089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.182985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.183320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.183602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] PATH_INFO: `/v3/users/f2f7733809494906981382736f409c6d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.184813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f7733809494906981382736f409c6d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.186755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.187801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 954/1931] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:06.191278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.191278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.191278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.192567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.208230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:06.209371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.218441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 955/1932] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:06.219362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.220797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.234898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e844f7-ee53-40bb-bddd-2c1596ddecf0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.239622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.240302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.240640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.240925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.241016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f7733809494906981382736f409c6d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.241659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.241765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f7733809494906981382736f409c6d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.243805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.254760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f7733809494906981382736f409c6d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.262606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f7733809494906981382736f409c6d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.269686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 956/1933] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:06.269934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f7733809494906981382736f409c6d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.270758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.272325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.276977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 978/1934] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:06 2022] DELETE /identity/v3/users/f2f7733809494906981382736f409c6d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:06.280632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.281900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.293585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.350536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7967-5900-48fa-9a30-510b4ae38e15 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.362540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a4749-681c-4c7c-bd34-c9151ac3ade9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.368097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.368772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.369105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.369459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.370209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.372317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.395904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 979/1935] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:06.401543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.418309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244aac-9cf8-43ba-9797-3163799fa268 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.426008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.426884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.427371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.427787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.428646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.429508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.430459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.430995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.431414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.431915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.433958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.444200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 980/1936] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:06.449245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.449443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.451314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.465088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 957/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:06.480194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab03efe-8b28-4319-bad3-b5163611136d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.488318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.489101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.489406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.489713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] PATH_INFO: `/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4/users/f4acd2c32a4a4efb824bb4f100b7b03e/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.507360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eb8f71e5744dd29a3eeefaef46fde4, user_id=f4acd2c32a4a4efb824bb4f100b7b03e, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.510537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.526367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 981/1938] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:06 2022] PUT /identity/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4/users/f4acd2c32a4a4efb824bb4f100b7b03e/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:06.530696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.543113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f55f-a04a-4555-86e9-e05acccec523 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.612745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.613668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.613958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.614366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.615112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.616723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaab12a-c994-4057-ad92-c5000b105f9d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.627511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 958/1939] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:06.631940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.643389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92fe1b-3b84-4e23-84d4-bee2094341e2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.650379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.651470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.651751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.652025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] PATH_INFO: `/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4/users/f4acd2c32a4a4efb824bb4f100b7b03e/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.654340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eb8f71e5744dd29a3eeefaef46fde4, user_id=f4acd2c32a4a4efb824bb4f100b7b03e, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.657333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.672212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 982/1940] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:06 2022] PUT /identity/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4/users/f4acd2c32a4a4efb824bb4f100b7b03e/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:06.684219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.684682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.685132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.716317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.717540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] MFA Rules not processed for user `f4acd2c32a4a4efb824bb4f100b7b03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:06.718947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.732852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.782079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.817000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.824564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792967-7e87-4a2e-8981-70f5b2425851 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.828887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 959/1941] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:06.834658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:06.837952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.838402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.838830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] PATH_INFO: `/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.840299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54244e2e4ddb41878ddcd5aaf112e0b8)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:06.841619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:06.843340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:06.843988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:06.898405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54244e2e4ddb41878ddcd5aaf112e0b8', 'request_id': 'req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.908295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54244e2e4ddb41878ddcd5aaf112e0b8', 'request_id': 'req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.916502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54244e2e4ddb41878ddcd5aaf112e0b8', 'request_id': 'req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.921822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310c73-30ae-4f1c-945e-bb7f73efc807 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:06.933460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] The token cache is being invalidate because project 54244e2e4ddb41878ddcd5aaf112e0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:06.934049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.935519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ca0aefd-2e44-45a6-b6dd-95e8c3607d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:06.938311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 983/1942] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:06 2022] DELETE /identity/v3/projects/54244e2e4ddb41878ddcd5aaf112e0b8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:06.944501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:06.944795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:06.945067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:06.986999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:06.988754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.025057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.025768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.026063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.026344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.034574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.081795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 984/1943] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:07.082829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.084348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.107017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bc9d0-d141-41ec-b80e-038782bc375f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.113160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.114069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.114422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.114701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] PATH_INFO: `/v3/projects/4b265a07c90a4133ace36f0294709c5a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.115997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b265a07c90a4133ace36f0294709c5a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.118550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.140783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.142355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9634f9-4d66-4022-a316-7c33c3912c9b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.153204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 960/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:07.154626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.154982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.155349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.175111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b265a07c90a4133ace36f0294709c5a', 'request_id': 'req-b66bcef8-82ff-4fed-b480-1068a8bd4258'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.178272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.179018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:07.180747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.186375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b265a07c90a4133ace36f0294709c5a', 'request_id': 'req-b66bcef8-82ff-4fed-b480-1068a8bd4258'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.196877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b265a07c90a4133ace36f0294709c5a', 'request_id': 'req-b66bcef8-82ff-4fed-b480-1068a8bd4258'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.211270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] The token cache is being invalidate because project 4b265a07c90a4133ace36f0294709c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:07.211727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.212478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b66bcef8-82ff-4fed-b480-1068a8bd4258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.220890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 985/1945] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:07 2022] DELETE /identity/v3/projects/4b265a07c90a4133ace36f0294709c5a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:07.220890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.220890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.220890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.242145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:07.244020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.259368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 961/1946] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:07.263892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.273669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.279486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538b191-09f1-4754-aa8d-23598de264b4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.284817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.285516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.285804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.286108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.286833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:07.287488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.288727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.301737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 962/1947] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:07.302517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.304501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.314638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 986/1948] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:07.318277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265e96-ba23-4c12-9e34-7e682e6e4ff0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.318512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.323735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.324608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.325238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.325551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] PATH_INFO: `/v3/users/9d7c73f7827a40e68f5dabdeeb0f4ec4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.327164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7c73f7827a40e68f5dabdeeb0f4ec4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.328743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.332800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c72675-f45a-4e38-b0e6-b8bebec7f997 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.338987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.339644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.339927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.340207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.341408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.343320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f4e62-e11b-4dbc-b281-b7dc9a75cc87 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.373921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 987/1949] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:07.375884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f03b-adc5-4a4c-beb2-d3e3ec948b8e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.376165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f03b-adc5-4a4c-beb2-d3e3ec948b8e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.376442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f03b-adc5-4a4c-beb2-d3e3ec948b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.384190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7c73f7827a40e68f5dabdeeb0f4ec4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.384974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7c73f7827a40e68f5dabdeeb0f4ec4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.393101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7c73f7827a40e68f5dabdeeb0f4ec4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.398631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e988f03b-adc5-4a4c-beb2-d3e3ec948b8e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:07.399875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e988f03b-adc5-4a4c-beb2-d3e3ec948b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.402725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7c73f7827a40e68f5dabdeeb0f4ec4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.403368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7c73f7827a40e68f5dabdeeb0f4ec4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:07.422533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 963/1950] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:07 2022] DELETE /identity/v3/users/9d7c73f7827a40e68f5dabdeeb0f4ec4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:07.423613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.426892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.468356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 988/1951] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:07.469674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.469964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.470244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.488722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:07.489898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.494017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1a2a8-c057-4bb5-a7bd-f5448863d8dd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.498265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 989/1952] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:07.501499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.501598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.501598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.501598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.501598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.501952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.502853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.508940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a6a7-ac01-48c2-b47f-6aba7d5863f3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.513920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.514572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.514851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.515123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.515842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:07.516142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.518350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.529357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 964/1953] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:07.529357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.529357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.531898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 990/1954] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:07.532896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.542868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb533c-0465-4980-8ad6-3da3b7a44594 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.547646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.548316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.548602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.548903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.549696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.552758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.575600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 991/1955] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:07.576914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.593126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096b28-0a60-4030-8493-9c21a1742afc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.600452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.601594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.602193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.603223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.604529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.607570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2760-42a3-41f5-9610-edfc0116e938 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.608232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.611820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.612464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.612747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.613023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.625964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.629029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.631075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.657536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 965/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:07.657728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 992/1957] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:07.657825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.662467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.667791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fe34b-346c-4ab8-9f62-44e995eb0d77 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.674387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.734046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.734726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.735013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.735291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.736045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.737682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.743573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3371-5f81-4b26-9fa9-1447b55a6bdc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.749617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 966/1958] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:07.753736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.754878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.755700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.756055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.756405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.757198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.761275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.765251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79bc3-8513-4b08-b69f-5e0f9bbf59ac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.770814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.772534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.772813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.773098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] PATH_INFO: `/v3/projects/9960fdf96c1d4649ae1cc9c714760bf5/users/7ecddbce14e540858e8e87e66ed7145d/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.786570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 993/1959] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:07.791428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.796060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9960fdf96c1d4649ae1cc9c714760bf5, user_id=7ecddbce14e540858e8e87e66ed7145d, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.798850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1adb7-a558-4371-b6e5-17953e889fd5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.803037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a850-16c6-4acf-8935-a1f22a59f6ec admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.808438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.809237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.809657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.809846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.810571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.812181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.815653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 967/1960] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:07 2022] PUT /identity/v3/projects/9960fdf96c1d4649ae1cc9c714760bf5/users/7ecddbce14e540858e8e87e66ed7145d/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:07.827994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.828283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.828562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.837452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 994/1961] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:07.843919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.855696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139fb95-663c-4288-b9ad-c94ce9e03976 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.867946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] MFA Rules not processed for user `7ecddbce14e540858e8e87e66ed7145d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:07.869089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:07.927644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.928325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.928662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.928941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.929705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:07.931666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:07.944126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 995/1962] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:07.948488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:07.960360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae71b-3f89-4463-b8ce-83923414d973 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:07.970600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 968/1963] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:07.970778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:07.970778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:07.970957 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:07.971443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] PATH_INFO: `/v3/projects/baeca9819ef9498ebfcc317d94b76e29/users/69b65b1461a341118469826a0235865d/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:07.972861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.005202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc687725-f060-4bd2-a202-8122c3027184 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.016253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeca9819ef9498ebfcc317d94b76e29, user_id=69b65b1461a341118469826a0235865d, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.016777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.017505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.017859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.018191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.018901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.020134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7cfd3-f08e-45a3-a1fd-3436fe81b398 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.021229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.052731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 996/1964] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:07 2022] PUT /identity/v3/projects/baeca9819ef9498ebfcc317d94b76e29/users/69b65b1461a341118469826a0235865d/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:08.065565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.065918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.066226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.127087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 969/1965] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:07 2022] POST /identity/v3/projects => generated 399 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:08.128246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.151857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] MFA Rules not processed for user `69b65b1461a341118469826a0235865d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:08.155522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.212646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.248034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec7f4-4abe-47a2-8198-ca9ed25d114a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.254825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.255594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.255898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.256223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.257016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.260642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.273195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.297452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 970/1966] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:08 2022] POST /identity/v3/users => generated 306 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:08.298942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.302477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.324834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b08d-37ff-4b37-a189-82d92eeba105 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.331219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 997/1967] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:08.331219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.342043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.342918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.343205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.343764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] PATH_INFO: `/v3/projects/8c294a6982374acd8d74e252b1c2b3f5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.345005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c294a6982374acd8d74e252b1c2b3f5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.347042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.350411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28745bf-51d5-424c-98e6-f5799678187d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.356024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.356750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.357206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.357528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.358259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.359945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.380183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 998/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:08.380183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.385688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.416749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c294a6982374acd8d74e252b1c2b3f5', 'request_id': 'req-bb5ba011-4aa3-4e06-8f09-442c70004c09'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.426018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c294a6982374acd8d74e252b1c2b3f5', 'request_id': 'req-bb5ba011-4aa3-4e06-8f09-442c70004c09'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.433348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c294a6982374acd8d74e252b1c2b3f5', 'request_id': 'req-bb5ba011-4aa3-4e06-8f09-442c70004c09'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.448762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] The token cache is being invalidate because project 8c294a6982374acd8d74e252b1c2b3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:08.449070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.449799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.451448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 971/1969] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:08 2022] DELETE /identity/v3/projects/8c294a6982374acd8d74e252b1c2b3f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:08.452184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.453988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.461825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7d093-ba5b-4aaf-a362-1f73ea59e1be admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.510998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.511560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.511836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.512113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.513896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.523195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba011-4aa3-4e06-8f09-442c70004c09 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.528983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.529933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.530215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.530498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] PATH_INFO: `/v3/projects/3381cbcd223844ab8773f458d7d0327b/users/aad2b4a103714752b31aa3e4a3a71d1f/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.548721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3381cbcd223844ab8773f458d7d0327b, user_id=aad2b4a103714752b31aa3e4a3a71d1f, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.551416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.566557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 972/1970] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:08 2022] PUT /identity/v3/projects/3381cbcd223844ab8773f458d7d0327b/users/aad2b4a103714752b31aa3e4a3a71d1f/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:08.569746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.569746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.581280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.582752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.592270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 999/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:08.593047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.603647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed17e2-1e73-4884-b417-51d0c433de50 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.605404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.644712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d499-84ec-43b6-9f74-def757530376 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.650966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.651768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.652708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.653037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.653272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] PATH_INFO: `/v3/users/f4acd2c32a4a4efb824bb4f100b7b03e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.654544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4acd2c32a4a4efb824bb4f100b7b03e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.656554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.667098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.667863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.668248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.668623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.669855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.671936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.687546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1000/1972] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:08.688551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.700170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2daf7-47ba-4221-a616-f3333aadcf3d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.707086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.708057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.708420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.708769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] PATH_INFO: `/v3/projects/3381cbcd223844ab8773f458d7d0327b/users/aad2b4a103714752b31aa3e4a3a71d1f/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.709995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4acd2c32a4a4efb824bb4f100b7b03e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.710876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4acd2c32a4a4efb824bb4f100b7b03e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.711378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3381cbcd223844ab8773f458d7d0327b, user_id=aad2b4a103714752b31aa3e4a3a71d1f, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:08.714766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dcd42-6722-4e84-a60f-1a7597aaf329 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:08.720964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4acd2c32a4a4efb824bb4f100b7b03e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.728766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1001/1973] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:08 2022] PUT /identity/v3/projects/3381cbcd223844ab8773f458d7d0327b/users/aad2b4a103714752b31aa3e4a3a71d1f/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:08.730668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4acd2c32a4a4efb824bb4f100b7b03e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.731455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4acd2c32a4a4efb824bb4f100b7b03e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:08.739256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.739452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.739727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.760211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 973/1974] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:08 2022] DELETE /identity/v3/users/f4acd2c32a4a4efb824bb4f100b7b03e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:08.769632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] MFA Rules not processed for user `aad2b4a103714752b31aa3e4a3a71d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:08.771020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.874563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1002/1975] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:08.887391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:08.889533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.993184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68184a-6706-4d83-8cdf-c4900133c94a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:08.997861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:08.998601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.999672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.999957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.014332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.018139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.030644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 974/1976] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:09.167706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.167706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:09.179993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea38f3a-82c2-4390-8aa0-f7ac8ae901cd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.184253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.184952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.185240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.185596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.187710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:09.221086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.222655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:09.301226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.302865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c542a1-8502-4891-a16c-bd429717919d service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.303373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:09.318367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704f186-5f85-466a-a2f7-18b157856852 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.322745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1003/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:09.323497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.324498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.324783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.325107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] PATH_INFO: `/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.326325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eb8f71e5744dd29a3eeefaef46fde4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.328223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.388108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eb8f71e5744dd29a3eeefaef46fde4', 'request_id': 'req-55b1371c-a41a-4d15-af34-0c4dea465b70'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:09.399932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eb8f71e5744dd29a3eeefaef46fde4', 'request_id': 'req-55b1371c-a41a-4d15-af34-0c4dea465b70'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:09.408572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eb8f71e5744dd29a3eeefaef46fde4', 'request_id': 'req-55b1371c-a41a-4d15-af34-0c4dea465b70'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:09.425602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] The token cache is being invalidate because project 05eb8f71e5744dd29a3eeefaef46fde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:09.426119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:09.427032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-55b1371c-a41a-4d15-af34-0c4dea465b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:09.432631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 975/1978] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:09 2022] DELETE /identity/v3/projects/05eb8f71e5744dd29a3eeefaef46fde4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:09.434690 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.434994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.435271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.474658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:09.475901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:09.552272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:09.577055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1004/1979] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:09.585055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.585372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.585823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.615360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:09.616582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:09.630641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 976/1980] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:09.635670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.646635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954551-55ab-4e63-ae83-b5adc73ce850 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.653158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.653953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.654292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.654563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.655295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:09.655600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.657275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.674435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1005/1981] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:09.678881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.692926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af480c6a-62b5-4eda-ba09-ae7390bd8078 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.699471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.700221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.700582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.700929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.701920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.706583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.749106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 977/1982] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:09 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:09.759937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.773009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be014e8a-3fc4-49f5-9349-da9e446ca8c7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.831763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.832446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.832728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.833013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.833737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.835704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.856910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1006/1983] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:09 2022] POST /identity/v3/users => generated 305 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:09.861144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.872643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefab64b-8d17-4b14-8425-044c5bab64f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.878040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.878700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.878987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.879294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.880025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.881622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.896778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 978/1984] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:09.898612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.910351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b89f04-98a2-4e27-8f3a-123e896b85d5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.915752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.916412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.916680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.916954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.917780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.919390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225613c-6111-4542-9f3a-b60cc1a9e141 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.931606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1007/1985] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:09.935872 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:09.946655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872f62-dc20-484b-b5c4-c969b168e1d6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:09.952102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:09.953000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:09.953287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:09.953606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] PATH_INFO: `/v3/projects/73b34615042147fd84ba3195e35d55b9/users/5def3496e124485298de0ee50cf5f6d2/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:09.969605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b34615042147fd84ba3195e35d55b9, user_id=5def3496e124485298de0ee50cf5f6d2, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:09.972294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:09.985738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 979/1986] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:09 2022] PUT /identity/v3/projects/73b34615042147fd84ba3195e35d55b9/users/5def3496e124485298de0ee50cf5f6d2/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:10.001897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.001897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.001897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.026592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] MFA Rules not processed for user `5def3496e124485298de0ee50cf5f6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:10.028676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:10.103387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1008/1987] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:10.107541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.176883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891128-a97f-4d28-92d2-bb9250795bd4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.183364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.184240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.184650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.185068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.185944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.188276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.222673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 980/1988] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:10 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:10.223934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.235034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5fa9-7c2a-4a8d-a833-b34804911f13 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.285817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:10.298937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.299606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.299888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.300158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.300838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.302787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.328785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1009/1989] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:10 2022] POST /identity/v3/users => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:10.330285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.339270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:10.345763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59c90-d092-495b-845e-9c7e6e799977 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.352252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.352911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.353190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.353544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.354441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.356034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.366784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 981/1990] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:10.370987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.381081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ffe-80dc-4f44-806d-be776ebb4a78 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.386578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.387452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.387736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.388013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] PATH_INFO: `/v3/projects/d9344d6dc73c409e9d2ae38186c67626/users/5da63408780a4767b4589fd97f72660b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.403645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9344d6dc73c409e9d2ae38186c67626, user_id=5da63408780a4767b4589fd97f72660b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.406382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.419050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1010/1991] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:10 2022] PUT /identity/v3/projects/d9344d6dc73c409e9d2ae38186c67626/users/5da63408780a4767b4589fd97f72660b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:10.423221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.434323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad373123-798c-4875-840a-51f7351642bd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.490914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.491570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.491850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.492124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.492909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.494596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e05b-a1da-40d7-a892-8da21311843f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.503964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 982/1992] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:10.508761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.519527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86964f7e-bca7-45ca-93e9-53ff41435102 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.525071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.525975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.526255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.526528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] PATH_INFO: `/v3/projects/d9344d6dc73c409e9d2ae38186c67626/users/5da63408780a4767b4589fd97f72660b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.528455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9344d6dc73c409e9d2ae38186c67626, user_id=5da63408780a4767b4589fd97f72660b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.531127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.540955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1011/1993] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:10 2022] PUT /identity/v3/projects/d9344d6dc73c409e9d2ae38186c67626/users/5da63408780a4767b4589fd97f72660b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:10.551969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.552259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.552540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.582600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] MFA Rules not processed for user `5da63408780a4767b4589fd97f72660b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:10.583811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:10.654097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 983/1994] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:10.664661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.666367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:10.724271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1e5d0-902e-4824-87ca-c50584eedf26 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.728481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.729124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.729438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.729722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:10.738850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:10.740284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:10.757756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1012/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:10.928673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:10.938895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040809b1-5ce3-4bdd-aec5-bb0c0093f7bb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:10.942425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:10.943059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:10.943339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:10.943613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:11.001085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:11.002549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:11.011943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 984/1996] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:16.718751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:16.720329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:16.824841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac5db-daa8-4f9a-9bf2-d6ed8ef783fc service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:16.832453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:16.833488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:16.833884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:16.834190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] PATH_INFO: `/v3/users/1518331772ba4762a6a33bcc1ff26fcf` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:16.839051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1518331772ba4762a6a33bcc1ff26fcf)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:16.841216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:16.903425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:16.904823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:16.919669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36d5fd-ed2e-43d6-bfc6-e22207a6b3b3 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:16.921884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:16.924471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1518331772ba4762a6a33bcc1ff26fcf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.924764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:16.925625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1518331772ba4762a6a33bcc1ff26fcf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.925747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:16.925954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:16.926236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] PATH_INFO: `/v3/users/7ecddbce14e540858e8e87e66ed7145d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:16.927458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecddbce14e540858e8e87e66ed7145d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:16.929408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:16.935984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:16.944323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1518331772ba4762a6a33bcc1ff26fcf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.952696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1518331772ba4762a6a33bcc1ff26fcf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.964439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b8d4dc7d-8ffe-446c-870d-040462d38488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1518331772ba4762a6a33bcc1ff26fcf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.972007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1013/1997] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:16 2022] DELETE /identity/v3/users/1518331772ba4762a6a33bcc1ff26fcf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:16.976239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:16.976527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:16.976930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:16.992461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecddbce14e540858e8e87e66ed7145d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.993282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecddbce14e540858e8e87e66ed7145d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:16.997734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:16.999607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.002004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecddbce14e540858e8e87e66ed7145d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.011865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecddbce14e540858e8e87e66ed7145d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.012697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-df5b1b59-42aa-4f35-bdc0-3ebd381d4320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecddbce14e540858e8e87e66ed7145d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.039300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 985/1998] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:16 2022] DELETE /identity/v3/users/7ecddbce14e540858e8e87e66ed7145d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:17.044299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:17.044592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:17.045041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:17.068358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:17.069733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.076303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1014/1999] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:17.089890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.091414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.151486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 986/2000] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:17.162464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.168330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d1e2d-9d25-44ed-9d58-ae5132ef8a0f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:17.239055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:17.239710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:17.239990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:17.240260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:17.254421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:17.256534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:17.260756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7158e-50cb-457e-b0cd-347839fc1c02 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:17.264875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:17.265789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:17.266267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:17.266865 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:17.274264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1015/2001] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:17.282273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:17.283734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:17.297333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 987/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:17.721471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.723018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.738573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.740286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.746490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d03c-c8a8-4374-8eea-4b995d46bf6a service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:17.762229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:17.763349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:17.763775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:17.764635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] PATH_INFO: `/v3/projects/182c3d3a273742ebb2dbad3c96c5d565` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:17.768323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=182c3d3a273742ebb2dbad3c96c5d565)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:17.771686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96b2cc-e516-4aa5-ab02-3d64eaa2da5e service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:17.775087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:17.777778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:17.778860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:17.779223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:17.779570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] PATH_INFO: `/v3/projects/9960fdf96c1d4649ae1cc9c714760bf5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:17.780974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9960fdf96c1d4649ae1cc9c714760bf5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:17.782990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:17.823023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:17.838706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:17.863878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182c3d3a273742ebb2dbad3c96c5d565', 'request_id': 'req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.869694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9960fdf96c1d4649ae1cc9c714760bf5', 'request_id': 'req-94042b8e-57b6-43c3-8b95-6ca9f5075628'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.870799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182c3d3a273742ebb2dbad3c96c5d565', 'request_id': 'req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.879756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182c3d3a273742ebb2dbad3c96c5d565', 'request_id': 'req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.880995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9960fdf96c1d4649ae1cc9c714760bf5', 'request_id': 'req-94042b8e-57b6-43c3-8b95-6ca9f5075628'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.892908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9960fdf96c1d4649ae1cc9c714760bf5', 'request_id': 'req-94042b8e-57b6-43c3-8b95-6ca9f5075628'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.897977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] The token cache is being invalidate because project 182c3d3a273742ebb2dbad3c96c5d565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:17.898257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.899204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.900773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1016/2003] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:17 2022] DELETE /identity/v3/projects/182c3d3a273742ebb2dbad3c96c5d565 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:17.904599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.906236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:17.912584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] The token cache is being invalidate because project 9960fdf96c1d4649ae1cc9c714760bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:17.913488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.915404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:17.917838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 988/2004] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:17 2022] DELETE /identity/v3/projects/9960fdf96c1d4649ae1cc9c714760bf5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:17.921954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:17.923732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:18.013049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e8ad-c2f1-4b3e-b2b9-4401b1988ebb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:18.040589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042b8e-57b6-43c3-8b95-6ca9f5075628 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:18.046357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:18.047255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.047533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.048221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] PATH_INFO: `/v3/users/aad2b4a103714752b31aa3e4a3a71d1f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.049559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad2b4a103714752b31aa3e4a3a71d1f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:18.051943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:18.095295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:18.096440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.097028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.097028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] PATH_INFO: `/v3/users/ee3a45408a7144aba8499e6a804382b5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.098274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3a45408a7144aba8499e6a804382b5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:18.100242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:18.109681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad2b4a103714752b31aa3e4a3a71d1f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.110367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad2b4a103714752b31aa3e4a3a71d1f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.119593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad2b4a103714752b31aa3e4a3a71d1f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.127604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad2b4a103714752b31aa3e4a3a71d1f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.128514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad2b4a103714752b31aa3e4a3a71d1f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.154787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 989/2005] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:17 2022] DELETE /identity/v3/users/aad2b4a103714752b31aa3e4a3a71d1f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:18.163681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3a45408a7144aba8499e6a804382b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.164400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3a45408a7144aba8499e6a804382b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.170090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:18.181188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3a45408a7144aba8499e6a804382b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.192892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3a45408a7144aba8499e6a804382b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.212844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3a45408a7144aba8499e6a804382b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.220614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1017/2006] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:17 2022] DELETE /identity/v3/users/ee3a45408a7144aba8499e6a804382b5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:18.604165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:18.606401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:18.628264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:18.633935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:18.677600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:18.736426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da83c-bb7d-49f2-b9e7-ba9e4d77c8b7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:18.741127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:18.741909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6c2c-52c4-4f07-a501-57416e18a4b8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:18.742886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.742886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.743325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] PATH_INFO: `/v3/projects/3381cbcd223844ab8773f458d7d0327b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.744546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3381cbcd223844ab8773f458d7d0327b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:18.746482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:18.747086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:18.747941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.748224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.748499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] PATH_INFO: `/v3/projects/655124d4fb3d468682b5239335f887a1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.749710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] RBAC: Authorizing `identity:delete_project(project_id=655124d4fb3d468682b5239335f887a1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:18.751595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:18.795296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3381cbcd223844ab8773f458d7d0327b', 'request_id': 'req-6f0077db-92c4-4279-b5c7-407105b2ac94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.798242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655124d4fb3d468682b5239335f887a1', 'request_id': 'req-b3c38085-260d-4e82-95ac-0224e6e7445a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.803156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3381cbcd223844ab8773f458d7d0327b', 'request_id': 'req-6f0077db-92c4-4279-b5c7-407105b2ac94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.804291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655124d4fb3d468682b5239335f887a1', 'request_id': 'req-b3c38085-260d-4e82-95ac-0224e6e7445a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.810926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3381cbcd223844ab8773f458d7d0327b', 'request_id': 'req-6f0077db-92c4-4279-b5c7-407105b2ac94'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.811218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655124d4fb3d468682b5239335f887a1', 'request_id': 'req-b3c38085-260d-4e82-95ac-0224e6e7445a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.824098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] The token cache is being invalidate because project 3381cbcd223844ab8773f458d7d0327b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:18.824387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.825070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6f0077db-92c4-4279-b5c7-407105b2ac94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.825903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] The token cache is being invalidate because project 655124d4fb3d468682b5239335f887a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:18.826205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.826793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 990/2007] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:18 2022] DELETE /identity/v3/projects/3381cbcd223844ab8773f458d7d0327b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:18.826900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b3c38085-260d-4e82-95ac-0224e6e7445a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:18.831586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1018/2008] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:18 2022] DELETE /identity/v3/projects/655124d4fb3d468682b5239335f887a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:18.833915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.834216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.834480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.857845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:18.859106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:18.924905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 991/2009] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:18.933268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.933630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.933909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.953926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:18.955185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:18.966413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1019/2010] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:18.970639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:18.982278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f5f3b-0ade-49dc-a7c5-1a3b829f7893 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:18.987124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:18.987886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:18.988180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:18.988514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:18.989192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:18.989521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:18.991119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.008409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 992/2011] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:12:19.014450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.030722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de934-8adb-47b5-9604-6f336c4d35e9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.036202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.036871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.037159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.037475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.038174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.041176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.075359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1020/2012] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:19.076670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.088539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593bbc3-44a5-4618-b3f4-71dda3fbc42b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.139379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:19.157520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.158192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.158480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.158761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.159460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.161412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.182982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 993/2013] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:19.187253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.199640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6720f9-f6c3-4e3e-a8ca-d44e2b94145b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.205059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.205909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.206263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.206612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.207422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.209168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.221699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1021/2014] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:19.225903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.236876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03446-c433-4a33-a869-0f5e5335ba62 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.241584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.242297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.242573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.242850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.243590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.245199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6696bee-0b64-4b87-9a84-df4ae3321ee4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.260789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 994/2015] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:19.262363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.278150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda4b77-7755-41e4-9c5d-2117d8e78234 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.282797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.283694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.283971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.284247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] PATH_INFO: `/v3/projects/8dd25fbb49ac494b9c50d4ccf249b262/users/259ab57a1f824ae091031494005f6e8e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.300618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd25fbb49ac494b9c50d4ccf249b262, user_id=259ab57a1f824ae091031494005f6e8e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.303457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.313796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:19.319887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1022/2016] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:19 2022] PUT /identity/v3/projects/8dd25fbb49ac494b9c50d4ccf249b262/users/259ab57a1f824ae091031494005f6e8e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:19.332274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.332681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.333008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.368312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] MFA Rules not processed for user `259ab57a1f824ae091031494005f6e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:19.369915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:19.446279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 995/2017] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:19.450542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.515221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8691bc-7452-4b64-9951-8cfa158213cd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.519836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.520752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.521029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.521296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.522013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.524072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.549415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1023/2018] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:19.553493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.564893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6a03-760a-4174-8578-0355ba5710ae None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.621530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.622192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.622474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.622752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.623444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.625353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.645909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 996/2019] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:19.651527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.662189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8722-e81e-4739-b0f3-7a9754c7a652 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.669131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.669850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.670137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.670403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.671138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.672738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.684451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1024/2020] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:19.688727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.700237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5853a-75d5-4992-a2a5-f72835d5cca1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.705004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.705921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.706257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.706537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] PATH_INFO: `/v3/projects/5130e45aa9f44423b614a295c31f0ba3/users/e6efd40e99614f0d881502bb38aac061/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.725160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5130e45aa9f44423b614a295c31f0ba3, user_id=e6efd40e99614f0d881502bb38aac061, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.728050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.741859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 997/2021] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:19 2022] PUT /identity/v3/projects/5130e45aa9f44423b614a295c31f0ba3/users/e6efd40e99614f0d881502bb38aac061/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:19.746555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.756793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7589-ae87-42fb-bd73-49c7e6f16818 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.816544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.817118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.817419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.817697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.818411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.819995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9b6f7-d103-4011-8b57-cb96db31dbeb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.831225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1025/2022] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:19.835406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.847379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a0c64-0628-43ef-8f2d-84baac5bccc6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:19.852406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:19.853371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.853678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.853950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] PATH_INFO: `/v3/projects/5130e45aa9f44423b614a295c31f0ba3/users/e6efd40e99614f0d881502bb38aac061/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.855992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5130e45aa9f44423b614a295c31f0ba3, user_id=e6efd40e99614f0d881502bb38aac061, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:19.858817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:19.870500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 998/2023] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:19 2022] PUT /identity/v3/projects/5130e45aa9f44423b614a295c31f0ba3/users/e6efd40e99614f0d881502bb38aac061/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:19.880422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:19.880708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:19.880985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:19.908158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] MFA Rules not processed for user `e6efd40e99614f0d881502bb38aac061`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:19.909369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:19.966352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:19.978333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1026/2024] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:19.989357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:19.991193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:20.002787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:20.054056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcc43-b9ad-4ddb-8d2f-ef5e6acd0fe8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:20.058604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:20.059308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:20.059588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:20.059867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:20.072368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:20.073804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:20.083396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 999/2025] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:20.194388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:20.204068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df6084-66a8-4924-aa2e-5efa6da43175 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:20.207727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:20.208381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:20.208653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:20.208924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:20.268084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:20.269554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf483-c9ce-44f8-b0a2-ba85c70ca1ba service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:20.278616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1027/2026] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:21.767337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:21.768903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:21.859031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cb34-63d2-47e9-81eb-135f1b706dd5 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:21.863853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:21.864647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:21.864931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:21.865206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] PATH_INFO: `/v3/users/fe754e741cde411993c39cab50e32f35` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:21.866437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe754e741cde411993c39cab50e32f35)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:21.868874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:21.923100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe754e741cde411993c39cab50e32f35'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:21.923805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe754e741cde411993c39cab50e32f35'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:21.931734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe754e741cde411993c39cab50e32f35'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:21.939340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe754e741cde411993c39cab50e32f35'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:21.940058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe754e741cde411993c39cab50e32f35'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:21.958507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1000/2027] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:21 2022] DELETE /identity/v3/users/fe754e741cde411993c39cab50e32f35 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:21.963424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:21.963893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:21.963983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:21.983703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:21.985180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.052678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1028/2028] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:22.063219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.064739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.103246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:22.128548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977296e-bf81-4de6-989c-f5fc30b42053 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.132619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.134326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.134611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.134895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.144374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.146113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1f95d-91e8-4ee6-8b66-657772cadd58 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.157073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1001/2029] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:22.459477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.461114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.473786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547adcf9-68f6-4c02-bf80-99aeed51999a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.479899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.480752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.481031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.481302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] PATH_INFO: `/v3/projects/ebc1449acac74d04bbd1a688ad767269` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.482698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc1449acac74d04bbd1a688ad767269)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.484608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.533920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc1449acac74d04bbd1a688ad767269', 'request_id': 'req-12c5eb39-baf5-408f-ab00-08ab6c9af75a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:22.540205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc1449acac74d04bbd1a688ad767269', 'request_id': 'req-12c5eb39-baf5-408f-ab00-08ab6c9af75a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:22.546834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc1449acac74d04bbd1a688ad767269', 'request_id': 'req-12c5eb39-baf5-408f-ab00-08ab6c9af75a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:22.559359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] The token cache is being invalidate because project ebc1449acac74d04bbd1a688ad767269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:22.559646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:22.560266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12c5eb39-baf5-408f-ab00-08ab6c9af75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:22.561831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1029/2030] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:22 2022] DELETE /identity/v3/projects/ebc1449acac74d04bbd1a688ad767269 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:22.566669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.566962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.567248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.588347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:22.589603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.652078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1002/2031] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:22.660050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.660356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.660625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.679461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:22.680699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.688969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1030/2032] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:22.693165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.703047 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6469-cea9-42f5-9d44-eaf6bafca60c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.707603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.708248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.708528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.708830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.709581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:22.709901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.712225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.723541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1003/2033] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:22.728212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.737425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab258dc4-17d9-4cbc-9573-6a2b4d56b547 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.743579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.744233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.744516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.744819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.745569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.747550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.751776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:22.780036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1031/2034] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:22.784354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.795335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ddbd-8f0d-4744-b36a-a1a15307f9bb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.860784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.861802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.862087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.862363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.863051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.865184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.911210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1004/2035] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:22 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:22.913438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.927140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b69c-3d83-4166-965e-0d55cef20232 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.933253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.933982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.934216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.934494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.935477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.937722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.955963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1032/2036] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:22.961421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.971946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168c47-cc4b-490b-81b0-ec2c90f868e1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.978040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.978694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.978973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.979248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.979972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.981602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0f184-8bcd-457f-aa43-f4da6d7431b1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.992086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1005/2037] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:22.997062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.012004 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667606-c5e3-4662-b7f9-cb81191367e5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.018442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.019816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.020102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.020660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] PATH_INFO: `/v3/projects/3b5ae8aa4b164bc293828d4be8b8d269/users/fde4f839985d48a8850b599de070117c/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.037275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5ae8aa4b164bc293828d4be8b8d269, user_id=fde4f839985d48a8850b599de070117c, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.040532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.054685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1033/2038] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:22 2022] PUT /identity/v3/projects/3b5ae8aa4b164bc293828d4be8b8d269/users/fde4f839985d48a8850b599de070117c/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:23.066418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.066961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.067247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.097054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] MFA Rules not processed for user `fde4f839985d48a8850b599de070117c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:23.099625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.134973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:23.181140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1006/2039] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:23.186093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.247604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb642e-4339-46f1-990a-0adceebf7ad5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.252234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.252880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.253161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.253475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.254159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.256071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.285038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1034/2040] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:23 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:23.286457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.297862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d783e2-15c4-4e8d-be6c-4739d6d7dfc3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.370645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.371401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.371616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.371896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.372600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.374604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.399341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1007/2041] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:23 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:23.400672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.414953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87836e-2db0-4231-8c99-6ddbebd225f2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.421094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.421782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.422063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.422340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.423062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.424787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.438665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1035/2042] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:23.444423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.457948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a4e0-f774-4414-8937-27357bc3ea7b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.465990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.467018 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.467528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.467808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] PATH_INFO: `/v3/projects/79bc12150d354270978e9b00c2f2b845/users/c456aae2ce054a56b15b24e28d2cb228/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.485990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bc12150d354270978e9b00c2f2b845, user_id=c456aae2ce054a56b15b24e28d2cb228, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.488772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.502723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1008/2043] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:23 2022] PUT /identity/v3/projects/79bc12150d354270978e9b00c2f2b845/users/c456aae2ce054a56b15b24e28d2cb228/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:23.506704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.517029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d272bc-19bf-44e3-9e23-c07af6ced678 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.575515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.576174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.576452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.576723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.577469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.579098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e020-11cc-4f17-9f1f-fe4e63f37515 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.589646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1036/2044] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:23.593982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.605485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b824-a141-4c95-96e8-90e17fa4995b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.610711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.611991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.612297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.612574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] PATH_INFO: `/v3/projects/79bc12150d354270978e9b00c2f2b845/users/c456aae2ce054a56b15b24e28d2cb228/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.614727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bc12150d354270978e9b00c2f2b845, user_id=c456aae2ce054a56b15b24e28d2cb228, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.617776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.628578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1009/2045] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:23 2022] PUT /identity/v3/projects/79bc12150d354270978e9b00c2f2b845/users/c456aae2ce054a56b15b24e28d2cb228/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:23.639707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.639994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.640273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.669600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] MFA Rules not processed for user `c456aae2ce054a56b15b24e28d2cb228`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:23.670842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.682611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:23.748339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1037/2046] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:23.759741 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.761482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.819749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029fc0-d98a-4990-bc65-6719315fddff admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.823993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.824642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.824925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.825203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.858589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:23.883964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.885417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3a97-2493-48c3-b116-ab86532190ca service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.894837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1010/2047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:29.966864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:29.968620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.051171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd276-4258-4dad-9a75-2cb82a560702 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.057054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.057984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.058264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.058552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] PATH_INFO: `/v3/users/5def3496e124485298de0ee50cf5f6d2` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.059782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5def3496e124485298de0ee50cf5f6d2)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.061755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.112233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5def3496e124485298de0ee50cf5f6d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.112891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5def3496e124485298de0ee50cf5f6d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.125283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5def3496e124485298de0ee50cf5f6d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.132554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5def3496e124485298de0ee50cf5f6d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.140613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5def3496e124485298de0ee50cf5f6d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.147076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1038/2048] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:29 2022] DELETE /identity/v3/users/5def3496e124485298de0ee50cf5f6d2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:30.151999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.152473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.152576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.170646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:30.171837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.230063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1011/2049] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:30.239802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.241186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.277493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.310932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215dd02-36aa-42ab-9501-ade1e1168bf3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.317162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.317162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.317162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.317162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.328328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.329882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.341686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1039/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:30.647017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.647145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.648532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.648658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.662049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc53bdf-b7fd-42ba-846c-3b07175d3ed0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.663128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e715f5-3ff1-47f9-9160-8cdf2485109d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.667848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.668419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.668717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.669000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.669284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] PATH_INFO: `/v3/projects/73b34615042147fd84ba3195e35d55b9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.669415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.669609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.669947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] PATH_INFO: `/v3/users/fde4f839985d48a8850b599de070117c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.670514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b34615042147fd84ba3195e35d55b9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.676820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde4f839985d48a8850b599de070117c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.678676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.689605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.735407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde4f839985d48a8850b599de070117c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.736122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde4f839985d48a8850b599de070117c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.744947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde4f839985d48a8850b599de070117c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.756621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde4f839985d48a8850b599de070117c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.757570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e8c729e1-a795-4fad-9c27-79a71c1cdb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde4f839985d48a8850b599de070117c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.761464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b34615042147fd84ba3195e35d55b9', 'request_id': 'req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.769107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b34615042147fd84ba3195e35d55b9', 'request_id': 'req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.776770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b34615042147fd84ba3195e35d55b9', 'request_id': 'req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.781411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1012/2051] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:30 2022] DELETE /identity/v3/users/fde4f839985d48a8850b599de070117c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:30.786332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.786625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.786950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.792688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] The token cache is being invalidate because project 73b34615042147fd84ba3195e35d55b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:30.792986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.793825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.798931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1040/2052] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:30 2022] DELETE /identity/v3/projects/73b34615042147fd84ba3195e35d55b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:30.802856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.804640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.808432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:30.809750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.866895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.885259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1013/2053] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:30.887068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22e6e-7d9a-46c7-8525-d4dab04fcccf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.892543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.893445 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.893730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.894100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] PATH_INFO: `/v3/users/5da63408780a4767b4589fd97f72660b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.895318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da63408780a4767b4589fd97f72660b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.895751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.897580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.897984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.960300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da63408780a4767b4589fd97f72660b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.961131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da63408780a4767b4589fd97f72660b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.967801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.976840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da63408780a4767b4589fd97f72660b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.982364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07516-0eee-4f67-ba63-1d0d7062b1c4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.986782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.987507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.987837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.988026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.989411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da63408780a4767b4589fd97f72660b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:30.998998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da63408780a4767b4589fd97f72660b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.004881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.006403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc52a7-6c26-403f-9b51-57e224ab91cc service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.017481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1041/2054] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:30 2022] DELETE /identity/v3/users/5da63408780a4767b4589fd97f72660b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:31.034716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1014/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:31.377859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.381019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.458634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab126a-4664-483d-8938-bef049df3264 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.465295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.466226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.466510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.466780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] PATH_INFO: `/v3/users/259ab57a1f824ae091031494005f6e8e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.468054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=259ab57a1f824ae091031494005f6e8e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.470052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.525997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259ab57a1f824ae091031494005f6e8e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.526655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259ab57a1f824ae091031494005f6e8e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.539841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259ab57a1f824ae091031494005f6e8e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.547209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259ab57a1f824ae091031494005f6e8e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.555167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259ab57a1f824ae091031494005f6e8e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.576036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1042/2056] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:31 2022] DELETE /identity/v3/users/259ab57a1f824ae091031494005f6e8e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:31.581044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.584392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.584392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.586044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.587698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.618978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:31.620855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.652248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:31.668212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2c004-9487-4a03-9a66-94dc598bf79d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.676522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.677399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.677689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.677963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] PATH_INFO: `/v3/projects/d9344d6dc73c409e9d2ae38186c67626` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.679145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9344d6dc73c409e9d2ae38186c67626)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.681722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.692222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1015/2057] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:31.696188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.697858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.712257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea484-165d-47ef-8a11-b917096f1e4a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.717590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.718481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.718799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.719206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] PATH_INFO: `/v3/projects/3b5ae8aa4b164bc293828d4be8b8d269` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.723012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5ae8aa4b164bc293828d4be8b8d269)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.723012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.733840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9344d6dc73c409e9d2ae38186c67626', 'request_id': 'req-63e132b9-07da-4dc5-a74f-846eba293903'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.739735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9344d6dc73c409e9d2ae38186c67626', 'request_id': 'req-63e132b9-07da-4dc5-a74f-846eba293903'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.748477 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9344d6dc73c409e9d2ae38186c67626', 'request_id': 'req-63e132b9-07da-4dc5-a74f-846eba293903'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.760447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] The token cache is being invalidate because project d9344d6dc73c409e9d2ae38186c67626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:31.760738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.761406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.766637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1043/2058] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:31 2022] DELETE /identity/v3/projects/d9344d6dc73c409e9d2ae38186c67626 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:31.766637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.766637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.777581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5ae8aa4b164bc293828d4be8b8d269', 'request_id': 'req-99bc2e77-3abf-467f-99bf-e12773088c66'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.785877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5ae8aa4b164bc293828d4be8b8d269', 'request_id': 'req-99bc2e77-3abf-467f-99bf-e12773088c66'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.793617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5ae8aa4b164bc293828d4be8b8d269', 'request_id': 'req-99bc2e77-3abf-467f-99bf-e12773088c66'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.805262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] The token cache is being invalidate because project 3b5ae8aa4b164bc293828d4be8b8d269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:31.805598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.806919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99bc2e77-3abf-467f-99bf-e12773088c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.811979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1016/2059] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:31 2022] DELETE /identity/v3/projects/3b5ae8aa4b164bc293828d4be8b8d269 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:31.811979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.811979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.811979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.827597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e132b9-07da-4dc5-a74f-846eba293903 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.831056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:31.832269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.842723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:31.879668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.880317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.880600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.880879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.882764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.900125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1017/2060] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:31.901008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.902332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.913999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475d89-1eab-45ba-9001-da2c524cab68 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.919462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.920331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.920616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.921024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] PATH_INFO: `/v3/users/c456aae2ce054a56b15b24e28d2cb228` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.922281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c456aae2ce054a56b15b24e28d2cb228)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.924197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.954396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:31.972455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.973984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7b2d-d3ba-4c9e-91cd-160b2a56c4a4 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.975051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c456aae2ce054a56b15b24e28d2cb228'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.975716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c456aae2ce054a56b15b24e28d2cb228'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.983299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c456aae2ce054a56b15b24e28d2cb228'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.984306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1044/2061] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:31.985594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.985883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.986163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.992215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c456aae2ce054a56b15b24e28d2cb228'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:31.993294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c456aae2ce054a56b15b24e28d2cb228'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.005592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:32.006814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.015172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1045/2062] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:32.019794 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1018/2063] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:31 2022] DELETE /identity/v3/users/c456aae2ce054a56b15b24e28d2cb228 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:32.020997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.034694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf40748-947a-4e01-8c4f-16f24fe20be5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.112046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.113169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.113680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.113960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.114943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:32.115082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.116596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.130622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1046/2064] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:32.135460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.148315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981326f5-5ed1-46f3-8d30-d975fb8579ab admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.167124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.168003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.168528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.168659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.169278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.171683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.205338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1019/2065] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:32 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:32.209774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.226663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b510-b9ae-466f-a3a4-e031fd3f01f7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.293478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.294467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.294911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.295343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.296365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.298612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.336693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1047/2066] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:32 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:32.341795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.354710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbbe65-d397-46e4-b375-481e61e1131d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.359629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.360306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.360586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.360867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.361759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.363589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.382749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.389870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.395132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1020/2067] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:32.397051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.430525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9485-431b-429f-927d-4071af32e28c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.437268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc2ec-0170-4072-9798-5943dc789e74 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.438691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.439547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.440021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.440480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.443261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.448145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.460974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1021/2068] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:32.462708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.464334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.465851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.466950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.467399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.467836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] PATH_INFO: `/v3/projects/8dd25fbb49ac494b9c50d4ccf249b262` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.480515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd25fbb49ac494b9c50d4ccf249b262)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.482758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235b96-f011-45c1-9039-e5efdaad7beb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.483638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.488028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.488997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.489608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.489888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] PATH_INFO: `/v3/projects/79bc12150d354270978e9b00c2f2b845` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.492085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bc12150d354270978e9b00c2f2b845)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.497442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.548958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd25fbb49ac494b9c50d4ccf249b262', 'request_id': 'req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.551785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:32.558916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd25fbb49ac494b9c50d4ccf249b262', 'request_id': 'req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.560299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:32.561521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bc12150d354270978e9b00c2f2b845', 'request_id': 'req-19c3804d-b8f8-4694-8413-89c5d0c7bad5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.570252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd25fbb49ac494b9c50d4ccf249b262', 'request_id': 'req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.572672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bc12150d354270978e9b00c2f2b845', 'request_id': 'req-19c3804d-b8f8-4694-8413-89c5d0c7bad5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.582434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bc12150d354270978e9b00c2f2b845', 'request_id': 'req-19c3804d-b8f8-4694-8413-89c5d0c7bad5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.586345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] The token cache is being invalidate because project 8dd25fbb49ac494b9c50d4ccf249b262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:32.586642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.588953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.594249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1048/2069] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:32 2022] DELETE /identity/v3/projects/8dd25fbb49ac494b9c50d4ccf249b262 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:32.595209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.596722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.610229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] The token cache is being invalidate because project 79bc12150d354270978e9b00c2f2b845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:32.610597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.611328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.613560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1022/2070] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:32 2022] DELETE /identity/v3/projects/79bc12150d354270978e9b00c2f2b845 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:32.614495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.615941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.674179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc62e1-bfe7-4509-bbb2-d80b2e8e7679 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.697817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3804d-b8f8-4694-8413-89c5d0c7bad5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:32.703685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.704584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.704988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.705520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] PATH_INFO: `/v3/users/e6efd40e99614f0d881502bb38aac061` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.706888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6efd40e99614f0d881502bb38aac061)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.708939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.748151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:32.749283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.749676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.749956 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] PATH_INFO: `/v3/projects/483dd815ed124530ad4f14db7b768573/users/75a9c5497b044c06a30f7053366b6916/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.763739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6efd40e99614f0d881502bb38aac061'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.764711 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6efd40e99614f0d881502bb38aac061'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.766077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=483dd815ed124530ad4f14db7b768573, user_id=75a9c5497b044c06a30f7053366b6916, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:32.768762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366d193-1813-443e-a250-f2329951ea8a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:32.773768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6efd40e99614f0d881502bb38aac061'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.781712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6efd40e99614f0d881502bb38aac061'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.782345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f964102c-1f8f-48dd-904b-f31c7c047da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6efd40e99614f0d881502bb38aac061'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:32.792878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1049/2071] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:32 2022] PUT /identity/v3/projects/483dd815ed124530ad4f14db7b768573/users/75a9c5497b044c06a30f7053366b6916/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:32.792878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2fb1-33f9-47c0-b7ce-75133c3a01be None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.792878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2fb1-33f9-47c0-b7ce-75133c3a01be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.792878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2fb1-33f9-47c0-b7ce-75133c3a01be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.802696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e77d2fb1-33f9-47c0-b7ce-75133c3a01be None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:32.803913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e77d2fb1-33f9-47c0-b7ce-75133c3a01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.811675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1023/2072] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:32 2022] DELETE /identity/v3/users/e6efd40e99614f0d881502bb38aac061 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:32.812994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.813279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.813597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.844928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] MFA Rules not processed for user `75a9c5497b044c06a30f7053366b6916`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:32.846845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.874500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1050/2073] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:32.882125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:32.882413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:32.882695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:32.897198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:32.904537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:32.905824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.919598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:32.933418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1024/2074] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:32.949287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:32.951476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:32.991101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1051/2075] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:32.992211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.002566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ad0c-8427-4a45-af8a-1b5fd02d7187 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.009734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.010671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.011244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.011787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.012802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:33.013018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.014663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.026229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29ce4a-2c76-49e3-9b7e-a7ea80a3170c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.029906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1052/2076] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:33.030405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.031285 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.031593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.031848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.034842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.042556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.044009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.045457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b3ce-7d47-4f68-89c8-a97d4be00d66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.050315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.050961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.051243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.051517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.052205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.054401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.054586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1025/2077] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:33.094598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1053/2078] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:33.096415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.112949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610909-a190-4bd7-aa76-c78b6259d62d service glance] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.137939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.140682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.189073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.189902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.190369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.190747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.191792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.195137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.229425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1026/2079] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:33.232149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.245994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e6ef-7fa0-4b71-9c69-4e3a336a4735 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.252241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.252918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.253203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.253515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.254333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.255933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.267150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c5a7-f686-4743-b0cc-d223314ecdaf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.268102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1027/2080] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:33.272460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.272956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.273476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.273829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.274190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] PATH_INFO: `/v3/projects/5130e45aa9f44423b614a295c31f0ba3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.275613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5130e45aa9f44423b614a295c31f0ba3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.277706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.284211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b34f-4db3-4c6e-b062-05bd8482df2a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.289789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.291081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.291540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.291883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.292828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.294560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.310004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1028/2081] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:33.317643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.329245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628514-f33b-4dec-a7cf-a09854416a2d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.334515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.335783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.336227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.336511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] PATH_INFO: `/v3/projects/bf767cbdfb6245efad3896c682612b97/users/4a085a585ee24effbc03361f7d41dfef/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.352256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5130e45aa9f44423b614a295c31f0ba3', 'request_id': 'req-03ea771b-c751-4014-89a0-77f2449a0628'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.354641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf767cbdfb6245efad3896c682612b97, user_id=4a085a585ee24effbc03361f7d41dfef, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.357345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04ddc-2b01-4680-b705-212e0d92d46d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.359318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5130e45aa9f44423b614a295c31f0ba3', 'request_id': 'req-03ea771b-c751-4014-89a0-77f2449a0628'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.367061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5130e45aa9f44423b614a295c31f0ba3', 'request_id': 'req-03ea771b-c751-4014-89a0-77f2449a0628'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.376012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1029/2082] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:33 2022] PUT /identity/v3/projects/bf767cbdfb6245efad3896c682612b97/users/4a085a585ee24effbc03361f7d41dfef/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:33.381713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] The token cache is being invalidate because project 5130e45aa9f44423b614a295c31f0ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:33.382187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.383127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03ea771b-c751-4014-89a0-77f2449a0628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.385229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1054/2083] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:33 2022] DELETE /identity/v3/projects/5130e45aa9f44423b614a295c31f0ba3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:33.387104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20754214-883d-4712-b31b-337d427713c7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.387416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20754214-883d-4712-b31b-337d427713c7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.387693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20754214-883d-4712-b31b-337d427713c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.390162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5f31-d7d4-42fd-af43-a8cd1c0a6d41 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.390463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5f31-d7d4-42fd-af43-a8cd1c0a6d41 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.390755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5f31-d7d4-42fd-af43-a8cd1c0a6d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.411731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-25cb5f31-d7d4-42fd-af43-a8cd1c0a6d41 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:33.411731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-25cb5f31-d7d4-42fd-af43-a8cd1c0a6d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.421625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.425480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-20754214-883d-4712-b31b-337d427713c7 None None] MFA Rules not processed for user `4a085a585ee24effbc03361f7d41dfef`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:33.427024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-20754214-883d-4712-b31b-337d427713c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.439764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.495373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1055/2084] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:33.504384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.505176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.505693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.534405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:33.535878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.537971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1030/2085] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:33.543106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20754214-883d-4712-b31b-337d427713c7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.544496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-20754214-883d-4712-b31b-337d427713c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.554440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1056/2086] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:33.558498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.561658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20754214-883d-4712-b31b-337d427713c7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.568108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6bb53-5c9e-4eee-bf8d-5fb30fa1365c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.569735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.570431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.570862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.571218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.572216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.573610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.574328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.574432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.574699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.575094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.575897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:33.576290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.578312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.604312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1057/2087] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:12:33.605953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.624101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1031/2088] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:33.628670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.633457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb651d-4fd6-43ad-9425-d644ad09693b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.727603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.729048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.729753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.730080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.731055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.736180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.757956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ed20-880b-4386-9248-fcaeb748f7eb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.764575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511d61-0786-461b-b02a-881734502079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.765324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511d61-0786-461b-b02a-881734502079 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.765701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511d61-0786-461b-b02a-881734502079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.766046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511d61-0786-461b-b02a-881734502079 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.766808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16511d61-0786-461b-b02a-881734502079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.768791 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16511d61-0786-461b-b02a-881734502079 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.777127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1058/2089] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:33.778764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.795071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1032/2090] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:33.799035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511d61-0786-461b-b02a-881734502079 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.811752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511d61-0786-461b-b02a-881734502079 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.849899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af373d2-3338-40f0-b307-8855f5a5f0fa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.855786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.857496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.857496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.857496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.857787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.861656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.885491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1059/2091] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:33 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:33.889426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.896117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.897591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.897591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.897591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.898474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.900369 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.901436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff1a5-86c6-43fc-94ba-62c14894b578 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.908873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.909675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.910133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.910526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.911483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.913174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.916968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.921705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1033/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:33.923343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.936169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2335-4e70-4f38-bc0c-ac3100273a4b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.937571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1060/2093] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:33.938981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.943215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.943883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.944164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.944439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.945315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.947618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.950399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cb74-b0a0-486e-907c-c13e58e94fb6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.955949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.956745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.957123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.957563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.958804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.960955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.964421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1034/2094] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:33.965465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.974649 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.981734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e7d0-17e4-431b-94e8-47bb6f715cb2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.987272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1061/2095] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:33.995388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.996848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.997845 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.998128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.998404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] PATH_INFO: `/v3/projects/a529e4ea146240a09032e1584cb7c202/users/6c309c2a4b194d969073f9499d3c4b03/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.006546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b77ec-213b-4067-8337-3d9c95bed149 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.013205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.014139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.014415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.014685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] PATH_INFO: `/v3/projects/9611fd574431452ab4c874fbad28c6a7/users/f3368f17ea6a422994fda4b0f22e76c3/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.022311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a529e4ea146240a09032e1584cb7c202, user_id=6c309c2a4b194d969073f9499d3c4b03, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.026116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee44c50-7441-4db7-8a3e-fd5718b8060d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.034070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9611fd574431452ab4c874fbad28c6a7, user_id=f3368f17ea6a422994fda4b0f22e76c3, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.037700 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98ec8-ca73-4189-9271-03d5ae844980 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.049480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1035/2096] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:33 2022] PUT /identity/v3/projects/a529e4ea146240a09032e1584cb7c202/users/6c309c2a4b194d969073f9499d3c4b03/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:34.060321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1062/2097] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:33 2022] PUT /identity/v3/projects/9611fd574431452ab4c874fbad28c6a7/users/f3368f17ea6a422994fda4b0f22e76c3/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:34.061985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.061985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.061985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.073600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.073909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.074198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.099186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] MFA Rules not processed for user `6c309c2a4b194d969073f9499d3c4b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:34.101348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:34.105705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] MFA Rules not processed for user `f3368f17ea6a422994fda4b0f22e76c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:34.107377 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:34.189438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1036/2098] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:34.193221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.194912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1063/2099] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:34.200358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.288192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad9c5-d3bc-4d06-afe9-20ebcba05e35 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.295673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.296365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.297825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.298194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.299263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.303419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.307382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a83f-d6c1-451d-aeaf-a3f54e22aad1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.333579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.335796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.336509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.336797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.337634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.339644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.357895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1037/2100] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:34.359427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.375705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1064/2101] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:34.379942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.434182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:34.443103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:34.452132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840b2-8435-4c75-9dbe-2fa92eb0aac5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.492664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8940-e7fc-4aa5-bd4c-84f1c3786e9f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.500331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.501567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.502996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.503469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.504656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.506960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.538342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.539303 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.539662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.540033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.541128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.541846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1065/2102] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:34.543428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.545799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.572648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024bc7-77ca-4396-801c-5c16d9b5e68b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.579770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1038/2103] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:34.583080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.589333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.589333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.594979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.595484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.596374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.598343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.607363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b422-84c3-48d9-b75f-9f220311e695 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.618238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1066/2104] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:34.622974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.624018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.624785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.625250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.625772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.626629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.632423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.643916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe4c-af83-4d8a-80c2-06a2a9805518 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.649227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.650213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.650591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.650870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] PATH_INFO: `/v3/projects/33dfec40694f46d88941b3ffe618925d/users/b6b9d5d4576a48afaf33d7c00832a83e/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.654874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1039/2105] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:34.658283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.673342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed047-73ca-4d6d-9e3c-70482d0b2025 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.676775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dfec40694f46d88941b3ffe618925d, user_id=b6b9d5d4576a48afaf33d7c00832a83e, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.679207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.679928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.680098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.680379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.680713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] PATH_INFO: `/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00/users/938a8ccd2e6e42f6ad1658d29a78dfff/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.699724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c0c4225ff4ecfb6147fbd1bdddc00, user_id=938a8ccd2e6e42f6ad1658d29a78dfff, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.699969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1067/2106] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:34 2022] PUT /identity/v3/projects/33dfec40694f46d88941b3ffe618925d/users/b6b9d5d4576a48afaf33d7c00832a83e/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:34.702994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.703848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.721866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1040/2107] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:34 2022] PUT /identity/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00/users/938a8ccd2e6e42f6ad1658d29a78dfff/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:34.725481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.795684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45766-17ef-4a1f-8b6d-4467f7e24a91 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.798623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988fe73-e985-4041-8785-0f6129809847 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.804033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.804376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.804964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.805093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.805240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.805348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.805546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.805713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.807078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.807582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.808694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.809195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.819445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1041/2108] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:34.819721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1068/2109] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:34.823684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.826544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.833166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4db80-577b-48cc-a54d-74c6594e92d7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.836127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360500-36f3-41c8-af9b-f6f096093c98 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.838015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.838869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.839147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.839420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] PATH_INFO: `/v3/projects/33dfec40694f46d88941b3ffe618925d/users/b6b9d5d4576a48afaf33d7c00832a83e/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.841112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.841346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dfec40694f46d88941b3ffe618925d, user_id=b6b9d5d4576a48afaf33d7c00832a83e, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.842000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.842282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.842555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] PATH_INFO: `/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00/users/938a8ccd2e6e42f6ad1658d29a78dfff/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.843975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe1b21-7c78-4170-b248-2399aa3da893 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.844523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c0c4225ff4ecfb6147fbd1bdddc00, user_id=938a8ccd2e6e42f6ad1658d29a78dfff, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.847256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115b91a-dfdf-4ed6-902f-6499ddcde306 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.855206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1042/2110] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:34 2022] PUT /identity/v3/projects/33dfec40694f46d88941b3ffe618925d/users/b6b9d5d4576a48afaf33d7c00832a83e/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:34.858417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1069/2111] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:34 2022] PUT /identity/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00/users/938a8ccd2e6e42f6ad1658d29a78dfff/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:34.866091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.866325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.866841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.868930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.869397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.869687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.893738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] MFA Rules not processed for user `b6b9d5d4576a48afaf33d7c00832a83e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:34.894938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:34.895896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] MFA Rules not processed for user `938a8ccd2e6e42f6ad1658d29a78dfff`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:34.897069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:34.925924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:34.971172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:34.975563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1043/2112] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:34.975726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1070/2113] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:34.988221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.989739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:35.011120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:35.012587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:35.055848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43895d29-2f00-4a67-80e2-6f1884250266 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:35.059621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:35.060271 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:35.060670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:35.060951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:35.076525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd952-9570-4ea2-8030-ff24ee5c1e84 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:35.080145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:35.080788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:35.081076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:35.081336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:35.092659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:35.094125 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:35.106524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1071/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:35.134726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:35.137991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:35.152278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1044/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:35.209709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:35.219909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b814d-3c0d-463c-a97b-a0fe4a8a86de service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:35.223562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:35.224206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:35.224492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:35.224828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:35.319752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:35.322626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:35.334714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1072/2116] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:38.861543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.871065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abb70f-3aa4-4ca2-807f-9d51490ce48a service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.875417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.876130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.876482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.876821 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.950179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.952020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b8308-413c-4a56-a04e-823886dd559d service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.962608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1045/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:39.578932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:39.589074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145e7c-eaf0-4ec0-8d3e-755e45e13261 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:39.592921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:39.593571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:39.593856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:39.594133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:39.604683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:39.606359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520433b-f048-44c6-8590-9ff0d5240a84 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:39.616431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1073/2118] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:43.860541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:43.861186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:43.861186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:43.862848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1046/2119] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:12:43.874961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a247-b88c-4184-a029-bef711339038 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:43.875432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a247-b88c-4184-a029-bef711339038 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:43.875588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a247-b88c-4184-a029-bef711339038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:43.893862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0113a247-b88c-4184-a029-bef711339038 None None] MFA Rules not processed for user `94a2e4c690694f1b8cf0ced06d7715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:43.895080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0113a247-b88c-4184-a029-bef711339038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:43.924507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:43.927009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:43.960081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:44.005943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1074/2120] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:12:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:44.018606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113a247-b88c-4184-a029-bef711339038 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.020028 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0113a247-b88c-4184-a029-bef711339038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:44.034776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113a247-b88c-4184-a029-bef711339038 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.043304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e1e2-3d5b-41b2-9216-1077f18f2ce9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.043529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.044372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.044795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.045481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.049458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.050329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.050627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.050922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] PATH_INFO: `/v3/users/c94a1d536a0f491dab3cf34a5b1e2d9b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.052158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94a1d536a0f491dab3cf34a5b1e2d9b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.054340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.065390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.067058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.085748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1075/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:44.121894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94a1d536a0f491dab3cf34a5b1e2d9b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.122626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94a1d536a0f491dab3cf34a5b1e2d9b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.130561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94a1d536a0f491dab3cf34a5b1e2d9b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.140192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94a1d536a0f491dab3cf34a5b1e2d9b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.140914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e51effc-c149-4005-b9e6-6df9495c19f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94a1d536a0f491dab3cf34a5b1e2d9b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.159533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1047/2122] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:43 2022] DELETE /identity/v3/users/c94a1d536a0f491dab3cf34a5b1e2d9b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:44.337503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.349336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478584b-d08b-4a5d-845c-b8360fd1604f service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.358287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:44.407712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.408566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.408844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.409118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] PATH_INFO: `/v3/projects/0955a8e221d146fa90cea6bd42bddb53` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.410391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0955a8e221d146fa90cea6bd42bddb53)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.412281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.458509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0955a8e221d146fa90cea6bd42bddb53', 'request_id': 'req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.464636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0955a8e221d146fa90cea6bd42bddb53', 'request_id': 'req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.470657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0955a8e221d146fa90cea6bd42bddb53', 'request_id': 'req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.483788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] The token cache is being invalidate because project 0955a8e221d146fa90cea6bd42bddb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:44.484090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.484699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d3027b4d-bf3c-4a15-a807-aafe5a1c72dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:44.486272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1076/2123] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:44 2022] DELETE /identity/v3/projects/0955a8e221d146fa90cea6bd42bddb53 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:44.491268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.491559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.491839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.511227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:44.512421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:44.572437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1048/2124] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:44.580413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.580632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.580910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.599319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:44.600504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:44.608920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1077/2125] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:44.613143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.623423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d7cd-00b5-48c3-86f1-b1103107c4d5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.628057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.628713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.628991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.629269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.630403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:44.630403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.631899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.644087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1049/2126] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:44.648565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.657914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294bf7-961a-470d-9b36-01245dcc7017 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.662780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.663429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.663715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.663994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.665198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.667150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.692682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1078/2127] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:44 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:44.696909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.707515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ee52-4e47-43a2-9d3b-984f36c7e29e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.733624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:44.771548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.772212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.772495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.772773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.773494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.775917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.796068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1050/2128] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:44 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:44.799585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.810107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ba496-c9e8-40a1-be5c-fa13eaf8f8b5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.814681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.815327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.815608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.815881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.816628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.818251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.828882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1079/2129] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:44.832790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.843177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422846aa-e0b4-42be-bf5a-3b8458c46ea1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.847772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.848413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.848697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.848974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.849782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.851363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246de0e-599f-4908-90ce-e14e690a3ac4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.861981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1051/2130] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:44.866168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:44.877214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444b06-f343-4656-8111-8b98c8bb45ab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:44.882142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:44.883044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.883324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.883838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] PATH_INFO: `/v3/projects/fde00bac11024d898d6d87b8d2abc29e/users/ee7405c2b1504907ba919e2797e63754/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.898556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde00bac11024d898d6d87b8d2abc29e, user_id=ee7405c2b1504907ba919e2797e63754, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:44.901784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:44.914764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1080/2131] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:44 2022] PUT /identity/v3/projects/fde00bac11024d898d6d87b8d2abc29e/users/ee7405c2b1504907ba919e2797e63754/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:44.920485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0f7e-ef69-40e4-9341-f6871050883a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:44.920778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0f7e-ef69-40e4-9341-f6871050883a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:44.921064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0f7e-ef69-40e4-9341-f6871050883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:44.938926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-534f0f7e-ef69-40e4-9341-f6871050883a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:44.940124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-534f0f7e-ef69-40e4-9341-f6871050883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:45.003401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1052/2132] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:45.010157 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:45.011863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:45.067040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:45.094208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee288d6e-8e27-4793-ba48-33e0ea5e01b3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:45.098795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:45.104337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:45.104657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:45.104945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:45.116519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:45.118090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:45.131736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1081/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:49.753888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a896b-5290-4723-ad70-2d073275921e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.754487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a896b-5290-4723-ad70-2d073275921e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.754487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a896b-5290-4723-ad70-2d073275921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.785518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ec4a896b-5290-4723-ad70-2d073275921e None None] MFA Rules not processed for user `ee7405c2b1504907ba919e2797e63754`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:49.786740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ec4a896b-5290-4723-ad70-2d073275921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.858628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1053/2134] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:49.876317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:49.877706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.961139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac62f-ef96-420e-946c-db918771245b service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:49.967005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:49.967657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.967936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.968213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.977163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:49.979000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:49.989421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1082/2135] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:51.665873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:51.666689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:51.667289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:51.685684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] MFA Rules not processed for user `ee7405c2b1504907ba919e2797e63754`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:51.686904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:51.693862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1054/2136] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:54.771211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:54.773468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:54.807224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33147f8-6bd7-411f-bf99-a59be1afa2dc service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:54.812283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:54.813250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:54.813959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:54.814311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] PATH_INFO: `/v3/users/4a085a585ee24effbc03361f7d41dfef` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:54.815717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a085a585ee24effbc03361f7d41dfef)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:54.817870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:54.897332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:54.899439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:54.906608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a085a585ee24effbc03361f7d41dfef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:54.907255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a085a585ee24effbc03361f7d41dfef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:54.914965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e8f0c-bcdf-472a-9e80-fcb74c325ee0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:54.920065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:54.920964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:54.921362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:54.921888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] PATH_INFO: `/v3/users/f3368f17ea6a422994fda4b0f22e76c3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:54.922037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a085a585ee24effbc03361f7d41dfef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:54.923178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3368f17ea6a422994fda4b0f22e76c3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:54.925106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:54.932840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a085a585ee24effbc03361f7d41dfef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:54.946605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-83f90d0a-e0db-41ad-91b7-59dc380c4988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a085a585ee24effbc03361f7d41dfef'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:54.956389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:54.960348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1083/2137] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:54 2022] DELETE /identity/v3/users/4a085a585ee24effbc03361f7d41dfef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:54.966627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419089-be15-481c-913b-a984bd9d573a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:54.966926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419089-be15-481c-913b-a984bd9d573a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:54.967204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419089-be15-481c-913b-a984bd9d573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:54.993554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dd419089-be15-481c-913b-a984bd9d573a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:54.993554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dd419089-be15-481c-913b-a984bd9d573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.005064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3368f17ea6a422994fda4b0f22e76c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.005992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3368f17ea6a422994fda4b0f22e76c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.016909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3368f17ea6a422994fda4b0f22e76c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.044648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3368f17ea6a422994fda4b0f22e76c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.045612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e57e5f97-8540-4224-9721-1f1497fc9610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3368f17ea6a422994fda4b0f22e76c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.060684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:55.085126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1055/2138] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:54 2022] DELETE /identity/v3/users/f3368f17ea6a422994fda4b0f22e76c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:55.090907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.091666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.092089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.105625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1084/2139] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:55.116922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419089-be15-481c-913b-a984bd9d573a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.117154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:55.118797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dd419089-be15-481c-913b-a984bd9d573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.119949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.202688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419089-be15-481c-913b-a984bd9d573a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.209779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1056/2140] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:55.220529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.222785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.286615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.287322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.287771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.287878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.298719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.300187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.300799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41047-445c-42d0-bde5-728dce39df41 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.304684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.305401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.305692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.305967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.315179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1085/2141] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:55.316192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.317659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.328428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1057/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:55.697010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.697010 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.698463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.701588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.713473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6c62-c46c-475f-b94e-da0e76642744 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.718468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.719418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.719778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.720134 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] PATH_INFO: `/v3/projects/9611fd574431452ab4c874fbad28c6a7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.721020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764199bc-ec81-4107-b604-cb91beee6d1a service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.721702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9611fd574431452ab4c874fbad28c6a7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.723592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.727475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.728026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.728229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.728510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] PATH_INFO: `/v3/projects/bf767cbdfb6245efad3896c682612b97` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.730059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf767cbdfb6245efad3896c682612b97)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.732260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.779097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:55.782582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9611fd574431452ab4c874fbad28c6a7', 'request_id': 'req-5c5e91e7-2b90-4b2a-8ddd-60b567234081'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.788606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9611fd574431452ab4c874fbad28c6a7', 'request_id': 'req-5c5e91e7-2b90-4b2a-8ddd-60b567234081'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.791074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf767cbdfb6245efad3896c682612b97', 'request_id': 'req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.794970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9611fd574431452ab4c874fbad28c6a7', 'request_id': 'req-5c5e91e7-2b90-4b2a-8ddd-60b567234081'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.799595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf767cbdfb6245efad3896c682612b97', 'request_id': 'req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.805923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf767cbdfb6245efad3896c682612b97', 'request_id': 'req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.806590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] The token cache is being invalidate because project 9611fd574431452ab4c874fbad28c6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:55.806884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.807527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.809107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1086/2143] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:55 2022] DELETE /identity/v3/projects/9611fd574431452ab4c874fbad28c6a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:55.812898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.814316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.818034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] The token cache is being invalidate because project bf767cbdfb6245efad3896c682612b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:55.818324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.818959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.821002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1058/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:55 2022] DELETE /identity/v3/projects/bf767cbdfb6245efad3896c682612b97 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:55.824704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:55.826027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:55.840019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:55.892850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e91e7-2b90-4b2a-8ddd-60b567234081 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.894833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e11b2-3fcc-4cd2-a521-8b97d204cc2a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:55.897935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.899569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.900077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.900408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:55.900844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] PATH_INFO: `/v3/users/b6b9d5d4576a48afaf33d7c00832a83e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.901284 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:55.901615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:55.901874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b9d5d4576a48afaf33d7c00832a83e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.901969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] PATH_INFO: `/v3/users/6c309c2a4b194d969073f9499d3c4b03` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:55.903110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c309c2a4b194d969073f9499d3c4b03)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:55.903951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.905031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:55.960771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c309c2a4b194d969073f9499d3c4b03'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.962182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c309c2a4b194d969073f9499d3c4b03'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.963386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b9d5d4576a48afaf33d7c00832a83e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.964248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b9d5d4576a48afaf33d7c00832a83e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.971137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c309c2a4b194d969073f9499d3c4b03'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.979342 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b9d5d4576a48afaf33d7c00832a83e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.981037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c309c2a4b194d969073f9499d3c4b03'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.981813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c309c2a4b194d969073f9499d3c4b03'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.989898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b9d5d4576a48afaf33d7c00832a83e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:55.999657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b9d5d4576a48afaf33d7c00832a83e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.002434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1059/2145] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:55 2022] DELETE /identity/v3/users/6c309c2a4b194d969073f9499d3c4b03 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:56.009425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1087/2146] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:55 2022] DELETE /identity/v3/users/b6b9d5d4576a48afaf33d7c00832a83e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:56.304086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:56.307605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.365469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:56.397817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5725c3-99f9-48dd-9f7c-774d33b5c2e6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:56.455736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:56.457167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.499451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:56.511180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.511611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.512010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] PATH_INFO: `/v3/users/69b65b1461a341118469826a0235865d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.514315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b65b1461a341118469826a0235865d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:56.517568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:56.543287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2376ea1-e0f1-400e-83c9-3470c26ba046 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:56.548886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:56.549901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.551845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.551845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] PATH_INFO: `/v3/projects/a529e4ea146240a09032e1584cb7c202` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.551845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a529e4ea146240a09032e1584cb7c202)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:56.554000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:56.579922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b65b1461a341118469826a0235865d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.580967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b65b1461a341118469826a0235865d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.591269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b65b1461a341118469826a0235865d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.599310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b65b1461a341118469826a0235865d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.600246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b65b1461a341118469826a0235865d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.608475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:56.616330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a529e4ea146240a09032e1584cb7c202', 'request_id': 'req-fae254d7-5588-454b-a809-adc31c304461'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.623944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1060/2147] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:56 2022] DELETE /identity/v3/users/69b65b1461a341118469826a0235865d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:56.627054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a529e4ea146240a09032e1584cb7c202', 'request_id': 'req-fae254d7-5588-454b-a809-adc31c304461'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.628101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:56.629491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.633836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a529e4ea146240a09032e1584cb7c202', 'request_id': 'req-fae254d7-5588-454b-a809-adc31c304461'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.651877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] The token cache is being invalidate because project a529e4ea146240a09032e1584cb7c202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:56.653406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.655474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fae254d7-5588-454b-a809-adc31c304461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.661507 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1088/2148] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:56 2022] DELETE /identity/v3/projects/a529e4ea146240a09032e1584cb7c202 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:56.663905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.664203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.664523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.691288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:56.692525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.738407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0991b-1690-477a-8a74-41f847b0b940 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:56.746024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:56.747273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.747660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.748044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] PATH_INFO: `/v3/projects/33dfec40694f46d88941b3ffe618925d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.749619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dfec40694f46d88941b3ffe618925d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:56.751747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:56.766167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:56.769747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1089/2149] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:56.775664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:56.777414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.792110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839870-8275-45e8-bc2a-56bb070abc1f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:56.798568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:56.799234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.799527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.799799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] PATH_INFO: `/v3/users/938a8ccd2e6e42f6ad1658d29a78dfff` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.809980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938a8ccd2e6e42f6ad1658d29a78dfff)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:56.812003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:56.813532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dfec40694f46d88941b3ffe618925d', 'request_id': 'req-990ae5d5-bfdb-49c8-960f-a2f446711557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.827358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dfec40694f46d88941b3ffe618925d', 'request_id': 'req-990ae5d5-bfdb-49c8-960f-a2f446711557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.837276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dfec40694f46d88941b3ffe618925d', 'request_id': 'req-990ae5d5-bfdb-49c8-960f-a2f446711557'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.854090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] The token cache is being invalidate because project 33dfec40694f46d88941b3ffe618925d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:56.854681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.855639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.857496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1061/2150] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:56 2022] DELETE /identity/v3/projects/33dfec40694f46d88941b3ffe618925d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:56.858353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:56.859748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:56.883928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938a8ccd2e6e42f6ad1658d29a78dfff'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.885093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938a8ccd2e6e42f6ad1658d29a78dfff'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.901008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938a8ccd2e6e42f6ad1658d29a78dfff'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.909142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938a8ccd2e6e42f6ad1658d29a78dfff'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.919656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70f4f7c8-1f7f-46e6-a43a-d937b1a581b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938a8ccd2e6e42f6ad1658d29a78dfff'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:56.928176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1090/2151] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:56 2022] DELETE /identity/v3/users/938a8ccd2e6e42f6ad1658d29a78dfff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:56.931040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e5cc-0ac9-475e-bed1-91fca4788da5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:56.931597 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e5cc-0ac9-475e-bed1-91fca4788da5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:56.931972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e5cc-0ac9-475e-bed1-91fca4788da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:56.950132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae5d5-bfdb-49c8-960f-a2f446711557 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:56.953286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b983e5cc-0ac9-475e-bed1-91fca4788da5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:56.954761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b983e5cc-0ac9-475e-bed1-91fca4788da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.014905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.056945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1091/2152] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:57.067727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.068091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.068440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.072819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.073890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.074175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.074503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.077316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.094974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.096626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.098101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.100426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.118869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1092/2153] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:57.119387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1062/2154] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:57.119934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.134546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6807f-038e-4382-a578-a20f3d1e880e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.145837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.147315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.147698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.149116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.150192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:57.151528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.154175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.174704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1093/2155] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:57.175855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.188646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052927e-6832-455a-913e-b1637d81ec78 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.194136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.194804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.195094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.195358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.196864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.199008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.231378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1063/2156] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:57.235479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.248174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b507f20-fa00-4994-aaef-6d74b7842615 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.335910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.336641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.336933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.337213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.338054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.340026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.358567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.360457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.372880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1094/2157] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/users => generated 282 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:57.374102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.389305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad56486-e407-479f-9131-45bafb087186 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.402660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25180ee-6750-40ec-824a-56913c67455b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.407646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.408586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.408870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.409149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] PATH_INFO: `/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.409656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.410489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.410935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.411351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.412233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.413706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019c0c4225ff4ecfb6147fbd1bdddc00)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.415177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.416196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.427983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1095/2158] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:57.435376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.447039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ec1f-53a2-459e-b223-d1aef88d9267 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.453656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.454410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.454841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.455673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.456499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.458562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.466558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.472620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1096/2159] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:57.477502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.488547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019c0c4225ff4ecfb6147fbd1bdddc00', 'request_id': 'req-57ee4c6f-a279-4e59-a6e9-49b14e85c679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.495139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca4ee0-8d33-4343-984f-1ae459240b7f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.500103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019c0c4225ff4ecfb6147fbd1bdddc00', 'request_id': 'req-57ee4c6f-a279-4e59-a6e9-49b14e85c679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.510703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019c0c4225ff4ecfb6147fbd1bdddc00', 'request_id': 'req-57ee4c6f-a279-4e59-a6e9-49b14e85c679'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.528078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] The token cache is being invalidate because project 019c0c4225ff4ecfb6147fbd1bdddc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:57.528538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.530603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-57ee4c6f-a279-4e59-a6e9-49b14e85c679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.532343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1064/2160] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:57 2022] DELETE /identity/v3/projects/019c0c4225ff4ecfb6147fbd1bdddc00 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:57.537814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75dbab-4917-410a-8f8c-eafa8fdb9187 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.538168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75dbab-4917-410a-8f8c-eafa8fdb9187 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.538548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75dbab-4917-410a-8f8c-eafa8fdb9187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.560534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dc75dbab-4917-410a-8f8c-eafa8fdb9187 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.570531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc75dbab-4917-410a-8f8c-eafa8fdb9187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.595979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.597480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.597910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.598431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] PATH_INFO: `/v3/projects/74a428dd2f004bff82b6b422b459b987/users/a5331e35ee0b4b6facc7acc8da7cc1a7/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.618927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a428dd2f004bff82b6b422b459b987, user_id=a5331e35ee0b4b6facc7acc8da7cc1a7, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.622294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f523-88d1-428e-b0e7-5957e144b16f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.649177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1097/2161] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:57 2022] PUT /identity/v3/projects/74a428dd2f004bff82b6b422b459b987/users/a5331e35ee0b4b6facc7acc8da7cc1a7/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:57.659011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.659385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.659728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.690053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1065/2162] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:57.693561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.694071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.694366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.699166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.702829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] MFA Rules not processed for user `a5331e35ee0b4b6facc7acc8da7cc1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.705112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.715943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.717157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.784493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1098/2163] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:57.790625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.793208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.798468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1066/2164] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:57.802567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.811923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca7fe-c493-4555-96d0-44db61666c5e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.813128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eb7d9-96e4-4d80-82c4-b74825ca1eb9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.817407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.818115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.818397 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.818674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.819411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:57.819717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.820104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.821805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.822242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.822425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.823133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.824115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.826651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.851315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1067/2165] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:12:57.859002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.869671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1099/2166] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:57.873722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.874241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe4f8-ae1a-47d0-aa22-2a33028b6b39 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.928548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.944817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.946102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.946501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.946790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.947500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.949544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.950452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922660-ec16-4be1-8702-826003768f29 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.958259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.959368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.959826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.960254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.961190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.964787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.984430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1068/2167] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:57.985928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.987795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.994430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1100/2168] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:57.997966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.007324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b20c-4a42-48fd-9b33-6662fdefe326 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.073248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece7f7-83fd-4edb-b3ce-5bb1cbd03372 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.079721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.080763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.080900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.081254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.081686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] PATH_INFO: `/v3/projects/baeca9819ef9498ebfcc317d94b76e29` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.081803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.082201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.082565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.083382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.083846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=baeca9819ef9498ebfcc317d94b76e29)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.085586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.090020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.104161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.115741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1101/2169] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:58.116797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.129642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986ca3-4420-42e6-a2ca-d4a31ea1ef11 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.137987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.138708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.139049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.139440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.140170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.142027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.152524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baeca9819ef9498ebfcc317d94b76e29', 'request_id': 'req-42cf235c-3c6d-44b4-af0a-77649ee8adfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:58.154324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1102/2170] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.155222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.165879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baeca9819ef9498ebfcc317d94b76e29', 'request_id': 'req-42cf235c-3c6d-44b4-af0a-77649ee8adfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:58.167950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e65f-4107-4732-87b6-acae35c18b89 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.175874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baeca9819ef9498ebfcc317d94b76e29', 'request_id': 'req-42cf235c-3c6d-44b4-af0a-77649ee8adfe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:58.196466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] The token cache is being invalidate because project baeca9819ef9498ebfcc317d94b76e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:58.196466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:58.197502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:58.204053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1069/2171] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:57 2022] DELETE /identity/v3/projects/baeca9819ef9498ebfcc317d94b76e29 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.204053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.204053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.254249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.254927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.255215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.255495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.256262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.258008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270dfd-6197-4c19-8431-089ea704da3f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.269019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1103/2172] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.270715 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.270997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.271310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.283846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf235c-3c6d-44b4-af0a-77649ee8adfe admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.288626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.289698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.289983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.290257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] PATH_INFO: `/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9/users/c9fb97d18577432f98dec8dd6ac0d7bc/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.290850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.292061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.298913 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.300371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1104/2173] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:58.307914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e9a2e4e4554631bc7fc27e9ead42d9, user_id=c9fb97d18577432f98dec8dd6ac0d7bc, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.308316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.310353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.311002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38168f14-a6ee-463e-a46c-5270d44dbc9c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.335247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d77a9f-08d3-4ead-aca6-8be6ea96de9b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.339210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1070/2174] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:58 2022] PUT /identity/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9/users/c9fb97d18577432f98dec8dd6ac0d7bc/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.340706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.341009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.341276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.370569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.372200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.423908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.425058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.425591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.425904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.426810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.428876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.442217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1105/2175] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.443267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.455734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f18a-d0c7-4e5f-b5af-327a70bc8441 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.460900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.461548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.461835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.462117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.462889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.464742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.477436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1106/2176] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.477630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1071/2177] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:58.477737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.480767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.488077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697294a-5232-4d4b-8141-ca27991de596 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.493844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84e05-73e5-4aba-8425-1930b3668be6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.494009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.494858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.495139 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.496070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] PATH_INFO: `/v3/projects/b23bb3e50977480db739a786dcf9827a/users/d1e03bec18c849e79bf2ce04ea496f62/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.502051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.504516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.505168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.505635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] PATH_INFO: `/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9/users/c9fb97d18577432f98dec8dd6ac0d7bc/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.509625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e9a2e4e4554631bc7fc27e9ead42d9, user_id=c9fb97d18577432f98dec8dd6ac0d7bc, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.512838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.515581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23bb3e50977480db739a786dcf9827a, user_id=d1e03bec18c849e79bf2ce04ea496f62, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.518313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cea325-cfd1-41a3-871b-456559307f30 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.527976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1072/2178] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:58 2022] PUT /identity/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9/users/c9fb97d18577432f98dec8dd6ac0d7bc/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.529645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.558625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1107/2179] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:58 2022] PUT /identity/v3/projects/b23bb3e50977480db739a786dcf9827a/users/d1e03bec18c849e79bf2ce04ea496f62/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.559927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf742f-11fb-4999-8357-225e966e6ba9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.560218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf742f-11fb-4999-8357-225e966e6ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.560536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf742f-11fb-4999-8357-225e966e6ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.590660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d1cf742f-11fb-4999-8357-225e966e6ba9 None None] MFA Rules not processed for user `c9fb97d18577432f98dec8dd6ac0d7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.591898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d1cf742f-11fb-4999-8357-225e966e6ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.619526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad4507-9e92-47d0-b147-25b08747666d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.628251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.681634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1108/2180] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:58.681634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.682081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.682393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.706399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.707151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.708765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.710118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.710551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.711154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.713188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:58.713188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.716104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.719972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1109/2181] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:58.722347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.727008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.736004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1073/2182] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:58.737059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.739219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.769290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.818126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc005c8-9645-4c31-8d76-1e0da7b58836 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.825051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.825765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.826061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.826347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.832377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f084ca7-09fd-48da-bdc3-3a748612d99e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.838545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.838892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.839354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.839710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.840089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.840374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.853688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1110/2183] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:58.854444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.859784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.861342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.865358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841b268-d9e2-4ae9-8459-c51e46bf47bd service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.871154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.871713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.871974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.872255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.873132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.875121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.878490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1074/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:58.921619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1111/2185] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:58.925994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.939970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43d94-dda8-4136-bec2-6f28bbd5c91d service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.974973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.032846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.033878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.033878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.034652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.034945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.037116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.068475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1075/2186] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:59.070601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.082264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba70e49-2cf6-4bfd-a7b2-cbd6e5a8a308 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.088645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.089336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.089645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.089921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9454-25c5-4e3e-8314-098307b46e32 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.090038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.090665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.092754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.094012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.094671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.095029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.095226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.097867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.105670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1076/2187] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:59.110629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.129063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8320b62-ac3c-4549-950f-5ef4d46b4305 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.137188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.138315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.138788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.139264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.141076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.143544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.160561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1077/2188] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:59.162069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.173291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0f32-e805-49da-b6a2-9f6dd480db45 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.183485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.184444 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.184830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.185206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] PATH_INFO: `/v3/projects/44823c52cd4b4ef2b252c1df1e739249/users/e966756f8a3c41e084adbf330c5f5de8/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.199885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:59.207508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.209702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7dd22-bca7-4e37-be99-c311f2274895 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.211458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44823c52cd4b4ef2b252c1df1e739249, user_id=e966756f8a3c41e084adbf330c5f5de8, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.217785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.220728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1112/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:59.251542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddef2-5f1f-4077-91b4-3cb3e8a1fc38 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.251835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddef2-5f1f-4077-91b4-3cb3e8a1fc38 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.252117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddef2-5f1f-4077-91b4-3cb3e8a1fc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.253474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1078/2190] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:59 2022] PUT /identity/v3/projects/44823c52cd4b4ef2b252c1df1e739249/users/e966756f8a3c41e084adbf330c5f5de8/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:59.286990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-250ddef2-5f1f-4077-91b4-3cb3e8a1fc38 None None] MFA Rules not processed for user `e966756f8a3c41e084adbf330c5f5de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:59.290738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-250ddef2-5f1f-4077-91b4-3cb3e8a1fc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.416893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1113/2191] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:59.438667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.441996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.546776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7435-9ab9-4476-b235-b41f8149bb03 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.552022 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.553592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.554069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.554535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.567148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.568726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.584891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1079/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:00.018278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:00.019072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:00.019072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:00.062836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] MFA Rules not processed for user `d1e03bec18c849e79bf2ce04ea496f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:00.064081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:00.165115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1114/2193] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:00.191923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:00.199543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:00.302723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c169c01-21f6-48d1-8549-5fcaa03b4758 service glance] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:00.306939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:00.307689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:00.308044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:00.308391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:00.331690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:00.334558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94b28c-ab83-4db2-a755-d57b272eebb4 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:00.354638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1080/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:02.158886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:02.238379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac218-f7c7-43c4-b422-5a512836864b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:02.245209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:02.246375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:02.246816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:02.247324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] PATH_INFO: `/v3/users/a5331e35ee0b4b6facc7acc8da7cc1a7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:02.250030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5331e35ee0b4b6facc7acc8da7cc1a7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:02.257182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:02.276174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.338541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5331e35ee0b4b6facc7acc8da7cc1a7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:02.339225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5331e35ee0b4b6facc7acc8da7cc1a7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:02.353309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5331e35ee0b4b6facc7acc8da7cc1a7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:02.363887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5331e35ee0b4b6facc7acc8da7cc1a7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:02.374830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5331e35ee0b4b6facc7acc8da7cc1a7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:02.384868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1115/2195] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:02 2022] DELETE /identity/v3/users/a5331e35ee0b4b6facc7acc8da7cc1a7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:02.390686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0f92-f7e7-4fba-bb75-78a13bba9129 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:02.391257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0f92-f7e7-4fba-bb75-78a13bba9129 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:02.391930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0f92-f7e7-4fba-bb75-78a13bba9129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:02.413856 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6d8d0f92-f7e7-4fba-bb75-78a13bba9129 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:02.416058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6d8d0f92-f7e7-4fba-bb75-78a13bba9129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:02.513583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1081/2196] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:02.526090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:02.527741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:02.618511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73811ac-cd74-4950-a8d5-977cb9651035 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:02.624065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:02.624854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:02.625270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:02.625662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:02.643481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:02.645769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:02.666744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1116/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:02.867790 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:02.867999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:02.868311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:02.895172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] MFA Rules not processed for user `d1e03bec18c849e79bf2ce04ea496f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:02.896781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.008812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1082/2198] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:03.149334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.151085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.166159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8ae34-77bb-4d76-b564-12ba8904945d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.172173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:03.173254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:03.173410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:03.173615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] PATH_INFO: `/v3/projects/74a428dd2f004bff82b6b422b459b987` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:03.174886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a428dd2f004bff82b6b422b459b987)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:03.176822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:03.234248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a428dd2f004bff82b6b422b459b987', 'request_id': 'req-8c4ee55b-bb59-46d4-b130-772d1719329a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.242407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a428dd2f004bff82b6b422b459b987', 'request_id': 'req-8c4ee55b-bb59-46d4-b130-772d1719329a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.252679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a428dd2f004bff82b6b422b459b987', 'request_id': 'req-8c4ee55b-bb59-46d4-b130-772d1719329a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.268685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] The token cache is being invalidate because project 74a428dd2f004bff82b6b422b459b987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:03.269055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.269761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.272158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1117/2199] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:03 2022] DELETE /identity/v3/projects/74a428dd2f004bff82b6b422b459b987 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:03.276159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.287405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb2de-8029-4bce-b5aa-9c7b5215c21a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.366580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:03.382420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:03.384171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:03.384555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:03.384911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] PATH_INFO: `/v3/users/c9fb97d18577432f98dec8dd6ac0d7bc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:03.386235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fb97d18577432f98dec8dd6ac0d7bc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:03.388843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:03.457761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fb97d18577432f98dec8dd6ac0d7bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.459279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fb97d18577432f98dec8dd6ac0d7bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.469036 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fb97d18577432f98dec8dd6ac0d7bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.481030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fb97d18577432f98dec8dd6ac0d7bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.482210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-15faad55-22dc-4a36-b8d6-be0ddecf2445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fb97d18577432f98dec8dd6ac0d7bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:03.503451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1083/2200] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:03 2022] DELETE /identity/v3/users/c9fb97d18577432f98dec8dd6ac0d7bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:03.885590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.888119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.908429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee55b-bb59-46d4-b130-772d1719329a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.942876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:04.044001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.045018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.045305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.045698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] PATH_INFO: `/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.046930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e9a2e4e4554631bc7fc27e9ead42d9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.048852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.122511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e9a2e4e4554631bc7fc27e9ead42d9', 'request_id': 'req-38e2da1e-6148-4760-b835-715b899b8323'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:04.131032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e9a2e4e4554631bc7fc27e9ead42d9', 'request_id': 'req-38e2da1e-6148-4760-b835-715b899b8323'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:04.137833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e9a2e4e4554631bc7fc27e9ead42d9', 'request_id': 'req-38e2da1e-6148-4760-b835-715b899b8323'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:04.163559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] The token cache is being invalidate because project e7e9a2e4e4554631bc7fc27e9ead42d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:04.163937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:04.165820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-38e2da1e-6148-4760-b835-715b899b8323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:04.170869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1118/2201] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:03 2022] DELETE /identity/v3/projects/e7e9a2e4e4554631bc7fc27e9ead42d9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:04.172743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.173063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.182244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.201636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:04.202880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:04.264469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1084/2202] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:04.272609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.272898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.273183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.294252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:04.295448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:04.303587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1119/2203] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:04.307903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.318050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c287d0-eb1e-48e3-b913-99df2808c2e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.323168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.323858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.324146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.324406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.325157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:04.325493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.327153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.340175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1085/2204] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:04.344496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.354855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86e50-fda9-4d96-9ffc-ff17fffe58ad None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.362079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.363069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.363744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.363744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.364828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.368688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.409084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1120/2205] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:04.413221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.428377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b587d-9cf6-4e17-b1ed-fed2b15310b9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.502679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.503375 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.503617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.504070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.504769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.506702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.514040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:04.530888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1086/2206] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:04.535094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.547024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961af5-1052-463f-981a-3a09433df253 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.551932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.552596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.552907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.553187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.553964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.555579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.566191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1121/2207] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:04.570909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.581299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf238cd8-869f-44de-80c4-f40bd2fa8fda admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.586603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.587338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.587594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.587942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.588582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.590273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467293-1495-4018-89b9-f63f88bf7c2c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.600998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1087/2208] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:04.605361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.615447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fec8-6fc3-420f-8453-2655e161c839 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.620129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.621000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.621285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.621605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] PATH_INFO: `/v3/projects/1a6bc9b2acf54ac7aa51386103b3d576/users/a3477901eee3420f96dcc74bd1df430d/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.636620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6bc9b2acf54ac7aa51386103b3d576, user_id=a3477901eee3420f96dcc74bd1df430d, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.639398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.655189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1122/2209] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:04 2022] PUT /identity/v3/projects/1a6bc9b2acf54ac7aa51386103b3d576/users/a3477901eee3420f96dcc74bd1df430d/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:04.665402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.665690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.665968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.694208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] MFA Rules not processed for user `a3477901eee3420f96dcc74bd1df430d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:04.696111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:04.760984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1088/2210] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:04.766031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.812519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:04.833602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcd26a-20a4-4a0c-8725-84883e671037 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.839396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.840082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.840374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.841515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.842229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.844156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.874413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1123/2211] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:04.875768 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.887943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eb61a-5498-481e-ab3c-16b11f4693a4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.949518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.950184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.950461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.950735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.951424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.953325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:04.972534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1089/2212] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:04 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:04.976635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:04.987399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9481-e112-4eb4-9fde-e669d8b26cba admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:04.993087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:04.993779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:04.994060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:04.994346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:04.995081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:04.996696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.007543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1124/2213] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:05.012338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.022509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a818-1f51-4931-af97-f355ffc99274 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.027940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.028818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.029098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.029401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] PATH_INFO: `/v3/projects/fdb4d0d68ce848ce83944a253376b4a9/users/4ffcefcd13984652a91a4aafb1e288e7/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.045056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb4d0d68ce848ce83944a253376b4a9, user_id=4ffcefcd13984652a91a4aafb1e288e7, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.047831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.062172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1090/2214] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:05 2022] PUT /identity/v3/projects/fdb4d0d68ce848ce83944a253376b4a9/users/4ffcefcd13984652a91a4aafb1e288e7/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:05.066344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.077323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d693fd-6c0b-4c20-8c62-62ab034cac31 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.141704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.143096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.143418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.143741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.144740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.147176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830a07-f7f6-446e-9189-3135788111ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.166593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1125/2215] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:05.168328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.179588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff08d6-75f7-4c7f-bc54-988ebef450a0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.185202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.186648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.186648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.186884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] PATH_INFO: `/v3/projects/fdb4d0d68ce848ce83944a253376b4a9/users/4ffcefcd13984652a91a4aafb1e288e7/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.188781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb4d0d68ce848ce83944a253376b4a9, user_id=4ffcefcd13984652a91a4aafb1e288e7, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.191472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.209421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1091/2216] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:05 2022] PUT /identity/v3/projects/fdb4d0d68ce848ce83944a253376b4a9/users/4ffcefcd13984652a91a4aafb1e288e7/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:05.218185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.218708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.218938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.251662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] MFA Rules not processed for user `4ffcefcd13984652a91a4aafb1e288e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:05.252963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.324365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1126/2217] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:13:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:05.335110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.336953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.360156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:05.398770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f952b-5bf6-43bd-855a-33846cb8dbcd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.402580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.403226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.403509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.403789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.462626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.464081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78a8a6-0dc7-466d-80cb-0b0a36fbb677 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.473642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1092/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:15.319737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:15.469111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=39 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:23.615329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.617367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:23.660221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a593c-4f79-4d0c-b0a8-c8b28d3c846e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.664475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.665112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.665420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.665705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.695501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.696929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.706338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1127/2219] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:33.702097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=28 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.238690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374d83-8e61-447d-994b-6d8d8327717d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.239217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374d83-8e61-447d-994b-6d8d8327717d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.239714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374d83-8e61-447d-994b-6d8d8327717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.261119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-06374d83-8e61-447d-994b-6d8d8327717d None None] MFA Rules not processed for user `d1e03bec18c849e79bf2ce04ea496f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:08.262365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-06374d83-8e61-447d-994b-6d8d8327717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.342936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1093/2220] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:08.359385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.457130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a6c5b-fea3-4435-a1d2-27afdc32be95 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.462404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.463825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.463825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.463825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] PATH_INFO: `/v3/users/a3477901eee3420f96dcc74bd1df430d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.465092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3477901eee3420f96dcc74bd1df430d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.467481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.519239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3477901eee3420f96dcc74bd1df430d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.519892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3477901eee3420f96dcc74bd1df430d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.532783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3477901eee3420f96dcc74bd1df430d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.540045 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3477901eee3420f96dcc74bd1df430d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.547852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3477901eee3420f96dcc74bd1df430d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.554302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1128/2221] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:08 2022] DELETE /identity/v3/users/a3477901eee3420f96dcc74bd1df430d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:08.558875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.559237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.559588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.600254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:08.601477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.664313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1094/2222] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:08.674912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.676335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.755929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.774412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf079f8-7769-4814-a149-18609faa3a9f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.778352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.779006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.779292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.779570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.789870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.791521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.802491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1129/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:09.134860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.136286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.160057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04adc9d-bfa9-4619-acd1-f634674ffd3a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.167066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.167999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.168373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.168822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] PATH_INFO: `/v3/projects/1a6bc9b2acf54ac7aa51386103b3d576` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.170244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6bc9b2acf54ac7aa51386103b3d576)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.172297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.231140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6bc9b2acf54ac7aa51386103b3d576', 'request_id': 'req-9cc27d89-42b2-4bd6-9db2-26e4381b215e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.243947 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6bc9b2acf54ac7aa51386103b3d576', 'request_id': 'req-9cc27d89-42b2-4bd6-9db2-26e4381b215e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.252130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6bc9b2acf54ac7aa51386103b3d576', 'request_id': 'req-9cc27d89-42b2-4bd6-9db2-26e4381b215e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.264956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] The token cache is being invalidate because project 1a6bc9b2acf54ac7aa51386103b3d576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:09.265421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.266105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.267662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1095/2224] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/projects/1a6bc9b2acf54ac7aa51386103b3d576 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.272222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.284740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0743-e753-4902-a57e-0d0af3030616 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.364111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.365772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.366061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.366339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] PATH_INFO: `/v3/users/4ffcefcd13984652a91a4aafb1e288e7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.368711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffcefcd13984652a91a4aafb1e288e7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.370899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.437624 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffcefcd13984652a91a4aafb1e288e7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.438622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffcefcd13984652a91a4aafb1e288e7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.457686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffcefcd13984652a91a4aafb1e288e7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.470726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffcefcd13984652a91a4aafb1e288e7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.482832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed9e516a-5fcd-4bdc-8865-6ae6b009347d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffcefcd13984652a91a4aafb1e288e7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.492007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1130/2225] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/users/4ffcefcd13984652a91a4aafb1e288e7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.519268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.521354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.550883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27d89-42b2-4bd6-9db2-26e4381b215e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.566654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.689734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.690842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.691225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.691621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] PATH_INFO: `/v3/users/75a9c5497b044c06a30f7053366b6916` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.693982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a9c5497b044c06a30f7053366b6916)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.696875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.749736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a9c5497b044c06a30f7053366b6916'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.750387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a9c5497b044c06a30f7053366b6916'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.757583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a9c5497b044c06a30f7053366b6916'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.766147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a9c5497b044c06a30f7053366b6916'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.766922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a9c5497b044c06a30f7053366b6916'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.786645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1096/2226] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/users/75a9c5497b044c06a30f7053366b6916 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.791749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.792037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.792317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.810687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:09.811976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.887856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1131/2227] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:09.900024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.901878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.931484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.934345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.955041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.970396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddceab3-f2b5-4372-ab01-288f9e90c17b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.982774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.983976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.984488 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.984948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] PATH_INFO: `/v3/projects/fdb4d0d68ce848ce83944a253376b4a9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.986374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb4d0d68ce848ce83944a253376b4a9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.989249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.997292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190f1f-f8ef-4910-8a6b-cc190feab504 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.001488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.001964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.002253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.002535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.023541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.025642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980876a-f926-4ec0-942d-4cb74da83336 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.043326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1097/2228] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:10.054707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb4d0d68ce848ce83944a253376b4a9', 'request_id': 'req-30bfe080-8320-496d-a5dd-208e0418c09b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.064211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb4d0d68ce848ce83944a253376b4a9', 'request_id': 'req-30bfe080-8320-496d-a5dd-208e0418c09b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.071596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb4d0d68ce848ce83944a253376b4a9', 'request_id': 'req-30bfe080-8320-496d-a5dd-208e0418c09b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.085975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] The token cache is being invalidate because project fdb4d0d68ce848ce83944a253376b4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:10.086284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.088115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-30bfe080-8320-496d-a5dd-208e0418c09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.089886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1132/2229] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/projects/fdb4d0d68ce848ce83944a253376b4a9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:10.095676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.095971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.096251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.159976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.161504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.166854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.258063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1098/2230] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.261133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.261468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.261778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.284743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.285984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.296363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1133/2231] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.300835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.314066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024df0ed-109a-4d00-92d0-85f930f5be57 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.317953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.318640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.318918 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.319190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.319923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:10.320227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.322052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.341557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1099/2232] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:10.342631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.352650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899adbee-0062-424a-a3e9-3d3e83852b95 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.358522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.359197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.359543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.360224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.361244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.363711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.395454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1134/2233] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:10.397361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.408295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ace36-a8fe-4bd1-a939-d92c136c3780 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.469048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.469752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.470038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.470319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.471059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.473033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.494921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1100/2234] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:10.499121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.510796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e726d2b-c800-43f6-a65e-e60b0aaffbe4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.515499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.516269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.516627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.516874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.517606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.519228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.533319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1135/2235] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:10.537460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.556300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd787b97-11ce-44cf-9806-30ef8fad49b2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.561501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.562188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.562540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.562824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.563568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.565195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865b5a4-b1a0-4080-9f3f-59edc3641482 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.577881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1101/2236] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:10.582298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.594748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea98-33b1-4c3a-bc7f-91c6309b6cf2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.599738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.600623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.600898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.601173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] PATH_INFO: `/v3/projects/d94199f7a36643e6940f25d7a1f92cc1/users/749ecc35873747598425192ceb0ef572/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.618704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94199f7a36643e6940f25d7a1f92cc1, user_id=749ecc35873747598425192ceb0ef572, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.621443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.658401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1136/2237] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:10 2022] PUT /identity/v3/projects/d94199f7a36643e6940f25d7a1f92cc1/users/749ecc35873747598425192ceb0ef572/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.670040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.670394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.670687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.707282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] MFA Rules not processed for user `749ecc35873747598425192ceb0ef572`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.708726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.720433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.722159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.841826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071250-11ab-4951-abd5-5e02eef597ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.847645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.848474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.848757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.849161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] PATH_INFO: `/v3/projects/483dd815ed124530ad4f14db7b768573` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.850464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] RBAC: Authorizing `identity:delete_project(project_id=483dd815ed124530ad4f14db7b768573)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.851561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1102/2238] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.855096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.855994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.863690 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.869275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18938-c467-4925-9a84-230169e1e55c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.876304 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.877014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.877581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.878099 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.878869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.880860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.902852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.918429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1103/2239] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:10.920363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.926085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483dd815ed124530ad4f14db7b768573', 'request_id': 'req-6e0334a3-a37b-48a0-afbb-d780ba8e86de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.932545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483dd815ed124530ad4f14db7b768573', 'request_id': 'req-6e0334a3-a37b-48a0-afbb-d780ba8e86de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.940421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483dd815ed124530ad4f14db7b768573', 'request_id': 'req-6e0334a3-a37b-48a0-afbb-d780ba8e86de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.960939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] The token cache is being invalidate because project 483dd815ed124530ad4f14db7b768573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:10.961325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.963410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6e0334a3-a37b-48a0-afbb-d780ba8e86de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.965857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1137/2240] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:10 2022] DELETE /identity/v3/projects/483dd815ed124530ad4f14db7b768573 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:10.972089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425767-4702-4dd7-8830-13fb3b346330 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.972453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425767-4702-4dd7-8830-13fb3b346330 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.972801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425767-4702-4dd7-8830-13fb3b346330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.998377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285fd1-1905-412c-a038-02b8ffd88c60 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.001953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-56425767-4702-4dd7-8830-13fb3b346330 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.003163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.003327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-56425767-4702-4dd7-8830-13fb3b346330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.003835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.004122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.004405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.005100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.007181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.014037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1138/2241] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:11.022553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.022915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.023591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.036849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1104/2242] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:11.041686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.043471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.049468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.050652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.056288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba9d4-eba9-4320-87c9-60d540b73643 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.061459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.062093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.062379 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.062660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.063401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.065008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.069012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1139/2243] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:11.073447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.081542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1105/2244] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:11.084636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.088737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b6af-3f13-4822-b541-5596832e3de6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.094847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.095508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.096446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.096696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf137-bafe-4be0-a257-3579dfa9164c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.096834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.097768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:11.098127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.101163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.103339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.104611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.105261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.105587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] PATH_INFO: `/v3/projects/59caa9bc00854953894f35d54239ada7/users/d94625d8cd5841f681092e5bf409a3d5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.119601 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1140/2245] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:11.124782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.128440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59caa9bc00854953894f35d54239ada7, user_id=d94625d8cd5841f681092e5bf409a3d5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.131395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.137314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b15c33-20a8-4a08-8c55-cb78d9b84a3f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.146995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.148212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.148377 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.149402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.150909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.153921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.156849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1106/2246] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:11 2022] PUT /identity/v3/projects/59caa9bc00854953894f35d54239ada7/users/d94625d8cd5841f681092e5bf409a3d5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:11.157395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.186089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1141/2247] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:11.190245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.254089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dbfa9-6026-4ca0-9e29-a80f1718849c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.273983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5106b04-bf7b-42d7-b6b8-0f258f4e7095 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.279880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.280707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.281041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.281316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.282070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.283998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.306171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.316386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1142/2248] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:11.320285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.332564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d9fd7-8943-4ac2-b7f8-a3923555b6c7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.335642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.336481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.337307 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.337763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.338626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.340956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.341560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.342231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.342513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.342939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.343766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.345451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.356864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1107/2249] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:11.361298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1143/2250] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:11.361515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.361734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.371790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4770f32-6fab-47fa-91fa-01f2449231f9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.372804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e261-4bcb-46e0-82e5-714e6aa06c98 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.376550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.377227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.377549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.377850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.377956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.378557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.378974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.379328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.379692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] PATH_INFO: `/v3/projects/59caa9bc00854953894f35d54239ada7/users/d94625d8cd5841f681092e5bf409a3d5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.380159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.382016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59caa9bc00854953894f35d54239ada7, user_id=d94625d8cd5841f681092e5bf409a3d5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.385281 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7570-d6a5-427b-b1fe-e8905718d0f3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.392310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1144/2251] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:11.396746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.397323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1108/2252] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:11 2022] PUT /identity/v3/projects/59caa9bc00854953894f35d54239ada7/users/d94625d8cd5841f681092e5bf409a3d5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:11.407183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f3ae-2600-4d88-ab81-f03793489bda None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.407476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f3ae-2600-4d88-ab81-f03793489bda None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.407759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f3ae-2600-4d88-ab81-f03793489bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.409566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4d18-7a52-4022-80ac-e05ab197c452 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.446919 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a523f3ae-2600-4d88-ab81-f03793489bda None None] MFA Rules not processed for user `d94625d8cd5841f681092e5bf409a3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.448168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a523f3ae-2600-4d88-ab81-f03793489bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.462272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.497211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.498207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.498500 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.498779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] PATH_INFO: `/v3/projects/fe7ccf695af44464ab75f4935679ae57/users/adce2e3b887a4e738b22d44257a55bbf/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.515683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7ccf695af44464ab75f4935679ae57, user_id=adce2e3b887a4e738b22d44257a55bbf, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.518451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.535106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1109/2253] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:11.535608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1145/2254] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:11 2022] PUT /identity/v3/projects/fe7ccf695af44464ab75f4935679ae57/users/adce2e3b887a4e738b22d44257a55bbf/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:11.546770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbedb-bee5-4efc-87d3-65e3edf4194f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.547065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbedb-bee5-4efc-87d3-65e3edf4194f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.547353 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbedb-bee5-4efc-87d3-65e3edf4194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.552762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.558046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.587358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ec3fbedb-bee5-4efc-87d3-65e3edf4194f None None] MFA Rules not processed for user `adce2e3b887a4e738b22d44257a55bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.588556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ec3fbedb-bee5-4efc-87d3-65e3edf4194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.647489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26acf2-46d3-43c4-93ad-538ec8ee51ea admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.651815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.652464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.652746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.653019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.669317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1110/2255] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.670445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.670733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.671016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.691266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] MFA Rules not processed for user `f49340b89c2a43b288572263ddac7be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.692584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.728854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.730369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.736173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.741594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1146/2256] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:11.742503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.743906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.755291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dde7c-aaf2-42b9-ba3b-8e9a557ab926 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.756454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1111/2257] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.759588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.760249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.760539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.761137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.775100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.776561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.794897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1147/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:11.799950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.811270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596a4b-1bb0-4073-8501-dd3c37e9979a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.815813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.816583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.817509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.817509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.819756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.908146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.909713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f22ab1-0123-491f-9639-b944804e16e0 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.924703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1112/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:12.203059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.205710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.255166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:12.299639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665357-c0b9-44e6-b92c-d8537e3230c9 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.305873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.307041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.307666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.307951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] PATH_INFO: `/v3/users/e966756f8a3c41e084adbf330c5f5de8` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.310922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e966756f8a3c41e084adbf330c5f5de8)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.313141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.392415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e966756f8a3c41e084adbf330c5f5de8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:12.393332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e966756f8a3c41e084adbf330c5f5de8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:12.410128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e966756f8a3c41e084adbf330c5f5de8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:12.421030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e966756f8a3c41e084adbf330c5f5de8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:12.431138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e966756f8a3c41e084adbf330c5f5de8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:12.438622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1148/2260] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:12 2022] DELETE /identity/v3/users/e966756f8a3c41e084adbf330c5f5de8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:12.443459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.443991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.444076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.468707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:12.469988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.534296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1113/2261] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:12.545796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.547276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.608465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2299d3-7d6b-4bbc-b546-069c2ed14e97 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.612165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.612811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.613092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.613367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.622765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.624199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.634043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1149/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:12.959914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.961964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.982077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7df5-1af4-4766-9590-0a742ac419ca None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.987599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.989331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.989331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.989331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] PATH_INFO: `/v3/projects/44823c52cd4b4ef2b252c1df1e739249` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.990431 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44823c52cd4b4ef2b252c1df1e739249)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.994882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.069010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44823c52cd4b4ef2b252c1df1e739249', 'request_id': 'req-c9afcbad-8f53-42be-afd0-0fcbb0c55692'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.079753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44823c52cd4b4ef2b252c1df1e739249', 'request_id': 'req-c9afcbad-8f53-42be-afd0-0fcbb0c55692'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.091282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44823c52cd4b4ef2b252c1df1e739249', 'request_id': 'req-c9afcbad-8f53-42be-afd0-0fcbb0c55692'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.109866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] The token cache is being invalidate because project 44823c52cd4b4ef2b252c1df1e739249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:13.110159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.110827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c9afcbad-8f53-42be-afd0-0fcbb0c55692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.112429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1114/2263] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:12 2022] DELETE /identity/v3/projects/44823c52cd4b4ef2b252c1df1e739249 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:14.555676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.557100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.569628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314b2-850f-489c-a9e8-e6531a32aa3d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.621480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.629718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.630740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.631058 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.631512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] PATH_INFO: `/v3/users/adce2e3b887a4e738b22d44257a55bbf` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.632837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adce2e3b887a4e738b22d44257a55bbf)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.635419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.679733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adce2e3b887a4e738b22d44257a55bbf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.681112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adce2e3b887a4e738b22d44257a55bbf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.692644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adce2e3b887a4e738b22d44257a55bbf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.700153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adce2e3b887a4e738b22d44257a55bbf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.707728 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adce2e3b887a4e738b22d44257a55bbf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.713705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1150/2264] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:14 2022] DELETE /identity/v3/users/adce2e3b887a4e738b22d44257a55bbf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:14.718223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.718703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.718839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.738101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.739309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.743713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.799952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1115/2265] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:14.810035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.811443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.872765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc64aac-3b55-4a7d-a74a-63a699823b60 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.876367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.877007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.877286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.877595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.887902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.889339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422bf5-0134-40d0-8bca-5a22a977c8e5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.899467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1151/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:15.223245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.225088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.245235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eef781-4b92-41c1-8744-39f8530e6325 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.252100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.253299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.253716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.254167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] PATH_INFO: `/v3/projects/fe7ccf695af44464ab75f4935679ae57` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.255897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7ccf695af44464ab75f4935679ae57)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.258265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.315025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7ccf695af44464ab75f4935679ae57', 'request_id': 'req-51b17f18-ed45-476f-b8e4-45cdfd8e038f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.323062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7ccf695af44464ab75f4935679ae57', 'request_id': 'req-51b17f18-ed45-476f-b8e4-45cdfd8e038f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.330514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7ccf695af44464ab75f4935679ae57', 'request_id': 'req-51b17f18-ed45-476f-b8e4-45cdfd8e038f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.342893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] The token cache is being invalidate because project fe7ccf695af44464ab75f4935679ae57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:15.343490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.344156 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.345758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1116/2267] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:15 2022] DELETE /identity/v3/projects/fe7ccf695af44464ab75f4935679ae57 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:15.350680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a6d0-42ac-4bbf-ba42-248b93a4222d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.350963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a6d0-42ac-4bbf-ba42-248b93a4222d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.351242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a6d0-42ac-4bbf-ba42-248b93a4222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.373361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-41a6a6d0-42ac-4bbf-ba42-248b93a4222d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.374649 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-41a6a6d0-42ac-4bbf-ba42-248b93a4222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.435781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.437440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.438755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1152/2268] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:15.446298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.446591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.446873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.457053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b17f18-ed45-476f-b8e4-45cdfd8e038f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.462579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.463559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.463925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.464287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] PATH_INFO: `/v3/users/749ecc35873747598425192ceb0ef572` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.465664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.465781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=749ecc35873747598425192ceb0ef572)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.466874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.467624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.474796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1153/2269] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:15.479565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.488447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc477e-f47b-41ca-8a1e-42abe51b8cff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.493842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.494533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.494858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.495147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.495888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:15.496193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.497925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.504885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:15.511052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1154/2270] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:15.515478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.517071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749ecc35873747598425192ceb0ef572'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.517778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749ecc35873747598425192ceb0ef572'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.526269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749ecc35873747598425192ceb0ef572'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.527873 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e870-be6f-43fd-b475-3d8b2024f578 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.532578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.533232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.533550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.533701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749ecc35873747598425192ceb0ef572'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.533945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.534346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-76952424-9892-4f2f-8fd5-fc89e2c5f74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749ecc35873747598425192ceb0ef572'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.534648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.536586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.552096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1117/2271] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:15 2022] DELETE /identity/v3/users/749ecc35873747598425192ceb0ef572 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:15.556706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.557113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.557526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.563905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1155/2272] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:15.564536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:15.568102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.570546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.580539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.581805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.642856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ff31-d7a8-4765-a32a-a016a4f786c8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.648050 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.649404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.649531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.649905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.650595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.654556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1118/2273] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:15.654723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.663331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.665503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.680770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1156/2274] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:15.682426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.692864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4f818-c5ad-4d71-a64e-9200939493db admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.698196 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.698844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.699127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.699401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.700123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.702001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.715662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1157/2275] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:15.716675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.727204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4370-c933-4c51-9e0f-8f739aa28ca2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.732232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.732792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411802a-4293-4e1c-9d61-377652ef18e3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.733265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.733265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.733469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.734147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.735750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.737729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.737936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.738273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.738599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.750636 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1158/2276] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:15.751363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.752297 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.752840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb34f0-0780-4b41-a108-3788775d8dcd service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.765066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495982e2-87bf-47a1-abeb-3d0162d0f6fe admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.765453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1119/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:15.769695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.770910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.771286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.771602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] PATH_INFO: `/v3/projects/c6d38275c24049f49fdadc77653d22b4/users/ba21a40b368a412087e42d8d3be71817/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.789277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d38275c24049f49fdadc77653d22b4, user_id=ba21a40b368a412087e42d8d3be71817, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.792768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.811461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1159/2278] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:15 2022] PUT /identity/v3/projects/c6d38275c24049f49fdadc77653d22b4/users/ba21a40b368a412087e42d8d3be71817/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:15.823382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.823612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.824487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.860103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] MFA Rules not processed for user `ba21a40b368a412087e42d8d3be71817`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.861363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.970088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1120/2279] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:15.982887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.984831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.050718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9883e4-c783-48a0-baac-82a4ad48a330 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.058630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.060791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.061148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.061603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.074866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.076274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.077998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.079822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.092685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1160/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:16.128253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.158849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460a485-a312-4e65-b3f2-375b8bbcfbf6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.163738 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.165336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.165751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.166135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] PATH_INFO: `/v3/projects/d94199f7a36643e6940f25d7a1f92cc1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.167448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94199f7a36643e6940f25d7a1f92cc1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.169516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.239550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94199f7a36643e6940f25d7a1f92cc1', 'request_id': 'req-20b1ac6e-ea43-4df5-9817-ec81da0733b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.256655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94199f7a36643e6940f25d7a1f92cc1', 'request_id': 'req-20b1ac6e-ea43-4df5-9817-ec81da0733b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.276395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94199f7a36643e6940f25d7a1f92cc1', 'request_id': 'req-20b1ac6e-ea43-4df5-9817-ec81da0733b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.311952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] The token cache is being invalidate because project d94199f7a36643e6940f25d7a1f92cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:16.312252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.313176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.330413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1121/2281] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/projects/d94199f7a36643e6940f25d7a1f92cc1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:16.334450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.356955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8d69-d650-4595-9d00-881ea816c0f7 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.408963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.472455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.474199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.475132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.475581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] PATH_INFO: `/v3/users/d94625d8cd5841f681092e5bf409a3d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.477268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94625d8cd5841f681092e5bf409a3d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.480190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.549985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94625d8cd5841f681092e5bf409a3d5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.551190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94625d8cd5841f681092e5bf409a3d5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.568805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94625d8cd5841f681092e5bf409a3d5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.578077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94625d8cd5841f681092e5bf409a3d5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.592709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8f72e09b-71fa-4eb8-b2de-1db39347c358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94625d8cd5841f681092e5bf409a3d5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.601112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1161/2282] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/users/d94625d8cd5841f681092e5bf409a3d5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:16.966992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.968960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.995056 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ac6e-ea43-4df5-9817-ec81da0733b5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.055512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.056410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.056664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.056931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] PATH_INFO: `/v3/projects/59caa9bc00854953894f35d54239ada7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.058131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59caa9bc00854953894f35d54239ada7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.060028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.106143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59caa9bc00854953894f35d54239ada7', 'request_id': 'req-b29c623c-ddc8-4949-9a6e-edbebd434415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.113283 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59caa9bc00854953894f35d54239ada7', 'request_id': 'req-b29c623c-ddc8-4949-9a6e-edbebd434415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.119229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59caa9bc00854953894f35d54239ada7', 'request_id': 'req-b29c623c-ddc8-4949-9a6e-edbebd434415'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.126464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.131377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] The token cache is being invalidate because project 59caa9bc00854953894f35d54239ada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:17.131859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.132766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b29c623c-ddc8-4949-9a6e-edbebd434415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.134928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1122/2283] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/projects/59caa9bc00854953894f35d54239ada7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.140497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.140801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.141073 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.161732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.162934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.222657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1162/2284] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.232106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.232395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.232689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.251458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.252678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.261313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1123/2285] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.265417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.276132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d915ee-6010-4d41-8f01-04a6fbc0654a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.280818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.281502 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.281788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.282189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.282926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:17.283240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.284863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.297003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1163/2286] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:17.301253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.310680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb378-2bd2-40af-b884-8529a890cb5e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.316417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.317097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.317581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.317862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.318568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.321057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.352778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1124/2287] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.356885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.367179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f817826-96b5-4e94-a609-385911406935 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.397278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.444831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.447376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.447376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.447948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.448824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.451838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.481550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1164/2288] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.484500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.499222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d199-9020-4bde-8607-77487202954b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.505158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.506023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.506425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.506805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.507814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.510372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.523029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1125/2289] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:17.527466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.538192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f9ac-a68b-4ca0-9d2e-91e951e5e99f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.544197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.545029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.545519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.545935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.546938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.549986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e31946-2970-433a-b4b0-3215bb8c0c6d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.572374 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1165/2290] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:17.577599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.588714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86da8ac-b191-4f9d-8a36-479e0b047141 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.594146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.595086 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.595377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.595654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] PATH_INFO: `/v3/projects/4b5f77a9850549fb8bd2a135d88a80aa/users/a0ad61a1fd554fee9bc11231012e8ba2/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.616509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5f77a9850549fb8bd2a135d88a80aa, user_id=a0ad61a1fd554fee9bc11231012e8ba2, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.619848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.649457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.649751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.650038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.651408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1126/2291] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:17 2022] PUT /identity/v3/projects/4b5f77a9850549fb8bd2a135d88a80aa/users/a0ad61a1fd554fee9bc11231012e8ba2/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.694602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] MFA Rules not processed for user `a0ad61a1fd554fee9bc11231012e8ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.697184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.807020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.811863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1166/2292] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.893688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c981a2-39f2-4a49-bf4a-83ca38924710 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.909177 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.910045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.910238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.910571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.911286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.913182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.948943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1127/2293] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.950179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.964070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645b29-79ab-42cf-80ef-1f3d08135522 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.034857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.035648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.036003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.037055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.037055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.039136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.065263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1167/2294] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:18.069168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.081174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea0336-960a-45d1-b358-e73feb7cdcfd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.093200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.094159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.094517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.094799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.095591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.097466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.109979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1128/2295] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:18.114011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.124260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730ccbd-228e-4d84-9ca9-9964ff612eab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.130302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.131516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.131987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.132513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] PATH_INFO: `/v3/projects/9f49df3e81954932b644ed718f2b1021/users/95bd214389534964b2eb5d8729cbedf3/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.152475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f49df3e81954932b644ed718f2b1021, user_id=95bd214389534964b2eb5d8729cbedf3, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.155133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.171305 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1168/2296] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:18 2022] PUT /identity/v3/projects/9f49df3e81954932b644ed718f2b1021/users/95bd214389534964b2eb5d8729cbedf3/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:18.175349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.186128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001876b8-7c86-4071-bfa2-1303fbcd4a5c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.245619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.246291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.246564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.246836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.247569 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.249302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb47c-0a8e-40f4-b39a-bced35999cb6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.263517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1129/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:18.264657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.270473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.277848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9137-2f37-43c1-a93b-b67ad058771e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.283146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.284128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.284411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.284714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] PATH_INFO: `/v3/projects/9f49df3e81954932b644ed718f2b1021/users/95bd214389534964b2eb5d8729cbedf3/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.286753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f49df3e81954932b644ed718f2b1021, user_id=95bd214389534964b2eb5d8729cbedf3, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.290059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.301684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1169/2298] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:18 2022] PUT /identity/v3/projects/9f49df3e81954932b644ed718f2b1021/users/95bd214389534964b2eb5d8729cbedf3/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:18.315731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.316714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.317005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.331590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.348543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] MFA Rules not processed for user `95bd214389534964b2eb5d8729cbedf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:18.350049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.424537 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1130/2299] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:18.437109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.438807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.497100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3e6-ecb4-431d-ac4a-6c4de89d703f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.501078 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.501756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.502041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.502319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.511350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.512787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.523436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1170/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:18.917964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.927229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec1e2-ee38-41a0-8fd0-b2633af6e6db None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.932315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bd214389534964b2eb5d8729cbedf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49df3e81954932b644ed718f2b1021', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.932912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.933197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.933505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.934316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:18.934627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.936221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.949328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1131/2301] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:18.953289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.963566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c30f-24b1-4a98-9678-7aba96d577b4 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.968262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bd214389534964b2eb5d8729cbedf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49df3e81954932b644ed718f2b1021', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.968909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.969198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.969515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.970240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.972148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.998498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1171/2302] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:19.002567 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.012959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb808-dff8-416b-bba9-be10839c2e48 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.074958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bd214389534964b2eb5d8729cbedf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49df3e81954932b644ed718f2b1021', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.075638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.075932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.076206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.076968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:19.077280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.078909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.090923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1132/2303] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:19.126432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.137487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b51a02-783b-4974-afbe-1186941718a5 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.143454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bd214389534964b2eb5d8729cbedf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49df3e81954932b644ed718f2b1021', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.144566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.145273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.145770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] PATH_INFO: `/v3/projects/8234728ce3fd4c24884302b6331b7cbb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.147235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8234728ce3fd4c24884302b6331b7cbb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.149331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.196583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8234728ce3fd4c24884302b6331b7cbb', 'request_id': 'req-bca42f25-f884-4b17-bf79-224ad7596be8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.202539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8234728ce3fd4c24884302b6331b7cbb', 'request_id': 'req-bca42f25-f884-4b17-bf79-224ad7596be8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.208582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8234728ce3fd4c24884302b6331b7cbb', 'request_id': 'req-bca42f25-f884-4b17-bf79-224ad7596be8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.221018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] The token cache is being invalidate because project 8234728ce3fd4c24884302b6331b7cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:19.221311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.221994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-bca42f25-f884-4b17-bf79-224ad7596be8 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.223577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1172/2304] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:19 2022] DELETE /identity/v3/projects/8234728ce3fd4c24884302b6331b7cbb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:19.403910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.405661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.471505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7899e-d21c-4183-8e7d-981e1077b710 tempest-VolumeQuotaClassesTest-1309049424 tempest-VolumeQuotaClassesTest-1309049424-project-admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.486590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.530958 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.531928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.532205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.532479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] PATH_INFO: `/v3/users/a0ad61a1fd554fee9bc11231012e8ba2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.533675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ad61a1fd554fee9bc11231012e8ba2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.535653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.580272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ad61a1fd554fee9bc11231012e8ba2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.580903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ad61a1fd554fee9bc11231012e8ba2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.587868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ad61a1fd554fee9bc11231012e8ba2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.594972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ad61a1fd554fee9bc11231012e8ba2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.595604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ad61a1fd554fee9bc11231012e8ba2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.613013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1133/2305] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:19 2022] DELETE /identity/v3/users/a0ad61a1fd554fee9bc11231012e8ba2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:19.618531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.618842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.619119 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.637017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:19.638270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.685941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.699056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1173/2306] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:19.708605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.710032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.767534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7416446-d7c2-4067-975e-22bcaf2fd00c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.771445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.772085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.772367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.772643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.783099 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.784553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.795348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1134/2307] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:20.085742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.087859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.121495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2d3c-de48-421f-b2c0-88c9bdef49f6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.126149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.127011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.127293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.127588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] PATH_INFO: `/v3/projects/4b5f77a9850549fb8bd2a135d88a80aa` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.128874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5f77a9850549fb8bd2a135d88a80aa)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.130838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.179380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5f77a9850549fb8bd2a135d88a80aa', 'request_id': 'req-db89faee-27ce-4de7-ac52-e53e806a05d9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.185482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5f77a9850549fb8bd2a135d88a80aa', 'request_id': 'req-db89faee-27ce-4de7-ac52-e53e806a05d9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.191602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5f77a9850549fb8bd2a135d88a80aa', 'request_id': 'req-db89faee-27ce-4de7-ac52-e53e806a05d9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.204401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] The token cache is being invalidate because project 4b5f77a9850549fb8bd2a135d88a80aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:20.204692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.205328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.207001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1174/2308] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:20 2022] DELETE /identity/v3/projects/4b5f77a9850549fb8bd2a135d88a80aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:20.211702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.221351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ff46-58dd-4856-b1e7-9d3bd943d62c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.261044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:20.281057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.281890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.282169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.282443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] PATH_INFO: `/v3/users/95bd214389534964b2eb5d8729cbedf3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.283620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bd214389534964b2eb5d8729cbedf3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.285551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.332558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bd214389534964b2eb5d8729cbedf3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.333212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bd214389534964b2eb5d8729cbedf3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.340825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bd214389534964b2eb5d8729cbedf3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.347508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bd214389534964b2eb5d8729cbedf3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.348161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-200be31c-0401-4401-be18-f9e8dfd32808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bd214389534964b2eb5d8729cbedf3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.369532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1135/2309] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:20 2022] DELETE /identity/v3/users/95bd214389534964b2eb5d8729cbedf3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:20.636768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.637747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.651268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89faee-27ce-4de7-ac52-e53e806a05d9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.713475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.714323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.714599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.714869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] PATH_INFO: `/v3/projects/9f49df3e81954932b644ed718f2b1021` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.716035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f49df3e81954932b644ed718f2b1021)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.717971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.763902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f49df3e81954932b644ed718f2b1021', 'request_id': 'req-918687e1-dcc6-476d-b38d-cea74425cbbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.769404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f49df3e81954932b644ed718f2b1021', 'request_id': 'req-918687e1-dcc6-476d-b38d-cea74425cbbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.775600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f49df3e81954932b644ed718f2b1021', 'request_id': 'req-918687e1-dcc6-476d-b38d-cea74425cbbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.787344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] The token cache is being invalidate because project 9f49df3e81954932b644ed718f2b1021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:20.787625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.788235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-918687e1-dcc6-476d-b38d-cea74425cbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.789836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1175/2310] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:20 2022] DELETE /identity/v3/projects/9f49df3e81954932b644ed718f2b1021 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:20.794761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.795058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.795343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.813860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:20.815001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.874440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1136/2311] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:20.883619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.884016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.884296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.896867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:20.903425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:20.905177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.912989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1176/2312] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:20.917426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.927168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4af78-5e50-43d1-84f8-3e0d94679cd9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.932626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.933277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.933586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.933858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.934584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:20.934889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.936508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.948850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1137/2313] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:20.952929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.962550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb156626-ab13-45c6-b1c7-f5860067e327 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.967681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.968368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.968654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.968933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.969672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.971598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.999020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1177/2314] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:21.002631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.014351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44905eea-f7e0-48ac-89fb-57ef43a93f94 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.058342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:21.072698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.073403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.073699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.073979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.074673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.076726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.095678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1138/2315] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:21 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:21.099724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.110976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427430-4167-40fb-96d3-65d00d06b0d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.115626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.116275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.116560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.116839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.118211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.119823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.132151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1178/2316] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:21.136807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.150231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d146f3-0ab8-4f83-a4c2-2eeb43071231 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.156205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.157085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.157479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.157835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.158680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.160489 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695dfdb-ccd2-480c-b060-59bb7ec2312d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.175680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1139/2317] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:21.176894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.187869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc1bd-541d-401f-961e-731fb1a62f72 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.192592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.193526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.193812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.194097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] PATH_INFO: `/v3/projects/446ddb12331b48c49d611587faeb92ae/users/ba979dcd6d54449ab6b9b44ea19e9125/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.209425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=446ddb12331b48c49d611587faeb92ae, user_id=ba979dcd6d54449ab6b9b44ea19e9125, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.212356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.226291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1179/2318] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:21 2022] PUT /identity/v3/projects/446ddb12331b48c49d611587faeb92ae/users/ba979dcd6d54449ab6b9b44ea19e9125/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:21.232570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f580f-ea00-4b06-bb24-5fd63db23617 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.233042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f580f-ea00-4b06-bb24-5fd63db23617 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.233236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f580f-ea00-4b06-bb24-5fd63db23617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.254656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a73f580f-ea00-4b06-bb24-5fd63db23617 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:21.255946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a73f580f-ea00-4b06-bb24-5fd63db23617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:21.323778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1140/2319] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:21.333912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.335722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:21.401491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8771725-fc68-4cb4-b391-53ef65bce9ad admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.405094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.405769 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.406052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.406329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.415962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.417422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.427581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1180/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:22.029532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.029817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.030561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.069139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] MFA Rules not processed for user `ba979dcd6d54449ab6b9b44ea19e9125`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:22.070961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:22.150719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1141/2321] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:22.155395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.166551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5e47-8a97-4808-94a3-d9295d695e19 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.171232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.171887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.172174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.172456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.173161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.175131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.205538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1181/2322] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:22 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:22.206984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.218667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4864f0-83c1-49c0-a2a2-9ec620987467 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.271282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:22.280114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.280788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.281069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.281343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.282071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.283988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.310485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1142/2323] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:22 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:22.313775 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.325165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4edd9-d6a7-4d86-9778-fedf5efcd7bf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.335003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.335678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.336052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.336349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.337122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.338954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.350811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1182/2324] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:22.355361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.367100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c5f0-d78c-47ba-8d68-671b4066896a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.373066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.373960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.374245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.374527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] PATH_INFO: `/v3/projects/680317a64dd043c48eb10b92d718c804/users/2b1bc95d74d848cca80b93cfe749da41/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.392139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680317a64dd043c48eb10b92d718c804, user_id=2b1bc95d74d848cca80b93cfe749da41, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.395311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.411734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1143/2325] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:22 2022] PUT /identity/v3/projects/680317a64dd043c48eb10b92d718c804/users/2b1bc95d74d848cca80b93cfe749da41/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:22.415768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.425837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41bef9-782a-4e25-84c5-61da5cffd621 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.493684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.494358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.494640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.494918 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.495698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.497336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a1def-53e5-4056-88de-672d725f8505 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.507771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1183/2326] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:22.512519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.525483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26322a-d661-42e9-88a1-e9cd734e59b9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.534170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.535196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.535580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.535961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] PATH_INFO: `/v3/projects/680317a64dd043c48eb10b92d718c804/users/2b1bc95d74d848cca80b93cfe749da41/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.538359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=680317a64dd043c48eb10b92d718c804, user_id=2b1bc95d74d848cca80b93cfe749da41, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.542192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.557079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1144/2327] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:22 2022] PUT /identity/v3/projects/680317a64dd043c48eb10b92d718c804/users/2b1bc95d74d848cca80b93cfe749da41/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:23.271117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:23.271591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:23.271854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:23.296146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:23.311031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] MFA Rules not processed for user `2b1bc95d74d848cca80b93cfe749da41`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:23.312496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:23.467882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1184/2328] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:23.483736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:23.487325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:23.556212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba1bf-35ab-4aeb-9cb9-98bb2cd1b0df admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:23.560378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:23.561020 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:23.561302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:23.561610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:23.629983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:23.631393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:23.641464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1145/2329] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:25.043788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.053664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e11e54-ebcf-4686-a29a-eeb537721be5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.057336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.058008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.058296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.058578 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.068242 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.069662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fb574-697e-4bbb-98cd-2a4c5833ac2d service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.092173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1185/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:25.444214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.446532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.518410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec670-fa4d-483f-b2e6-f28493e65d96 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.523364 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.524767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.525043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.525313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] PATH_INFO: `/v3/users/ba21a40b368a412087e42d8d3be71817` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.526550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba21a40b368a412087e42d8d3be71817)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.528693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.531831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:25.582211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba21a40b368a412087e42d8d3be71817'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.582852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba21a40b368a412087e42d8d3be71817'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.589650 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba21a40b368a412087e42d8d3be71817'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.597232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba21a40b368a412087e42d8d3be71817'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.597924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba21a40b368a412087e42d8d3be71817'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.615703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1146/2331] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:25 2022] DELETE /identity/v3/users/ba21a40b368a412087e42d8d3be71817 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:25.620969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.621258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.621569 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.638911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:25.640163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.703284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1186/2332] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:25.712981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.714430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.772695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b433-7349-4ea0-a881-35290c259b37 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.777068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.777761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.778062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.778323 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.787939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.790190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746b262-dee7-4d3a-8003-46b6b74f0447 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.800021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1147/2333] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:26.081859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.083320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.095958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf846a-9975-4a56-a480-27a905988d18 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.100820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.102368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.102617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.103089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] PATH_INFO: `/v3/projects/c6d38275c24049f49fdadc77653d22b4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.104854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d38275c24049f49fdadc77653d22b4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.107060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.155925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d38275c24049f49fdadc77653d22b4', 'request_id': 'req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.161453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d38275c24049f49fdadc77653d22b4', 'request_id': 'req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.168618 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d38275c24049f49fdadc77653d22b4', 'request_id': 'req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.181529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] The token cache is being invalidate because project c6d38275c24049f49fdadc77653d22b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:26.181826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.182454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed8898d8-80b5-44e5-96f1-c6eaa21b9d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.183997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1187/2334] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:26 2022] DELETE /identity/v3/projects/c6d38275c24049f49fdadc77653d22b4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:26.189054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.189343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.189656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.208494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:26.209647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.273160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1148/2335] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:26.281108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.281479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.281768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.289979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:26.303691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:26.306100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.320433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1188/2336] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:26.324876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.336238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305774cc-a9e0-462f-b337-23eaad5a8e87 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.341471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.342215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.342571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.342852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.343588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:26.343904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.345576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.359764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1149/2337] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:26.364034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.374373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e76ae-2d26-4c65-ad13-df436705ad8b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.379240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.379893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.380180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.380459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.381150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.383353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.408698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1189/2338] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:26.413433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.424096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe974f-b437-4492-9aaf-f2ef5b9559a7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.444286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:26.502532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.503295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.503645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.503998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.504766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.506718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.530521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1150/2339] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:26.531985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.544558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd17820-e507-422c-856d-dabc0b248fb2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.559164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.559833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.560111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.560382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.561255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.562906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.575550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1190/2340] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:26.580111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.592099 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928be2-5726-42af-ab0c-f0980e1ef0ad admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.597115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.597935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.598373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.598837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.599676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.602552 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463764-dd94-4359-8167-2f046a9afe66 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.615021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1151/2341] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:26.619756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.631087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c43fb-1237-4bac-8365-d801c5e93ae4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.636216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.637158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.637480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.638282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] PATH_INFO: `/v3/projects/a80966bf28184a9f8e9987632f7c0973/users/6f577abe1ada45979d5cb550073ae6a8/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.655796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80966bf28184a9f8e9987632f7c0973, user_id=6f577abe1ada45979d5cb550073ae6a8, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.658720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.671320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1191/2342] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:26 2022] PUT /identity/v3/projects/a80966bf28184a9f8e9987632f7c0973/users/6f577abe1ada45979d5cb550073ae6a8/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:26.676404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.676694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.676976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.695382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:26.697049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.756388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1152/2343] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:26.765978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.767682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.825072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e854e-3f73-4452-8bed-b59831ae5fab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.828709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.829340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.829650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.829927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.839479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.840909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492775aa-9ef8-465c-bcc4-28d59f24cc54 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.850296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1192/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:30.014460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.015910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.135719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbfae4-6772-45a2-b3be-67351fd51359 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.141925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.142678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.143159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.143471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.145989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.160886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.162702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.169732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.175593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1153/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:32.032803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.033800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.034289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.074340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] MFA Rules not processed for user `6f577abe1ada45979d5cb550073ae6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:32.076111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.199518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1193/2346] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:32.203718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.217558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d11a-6dd8-45f4-bd40-d43e8a410ddc service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.224896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.225805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.226483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.227355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.229469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.231931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.270643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1154/2347] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:32.275444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.288423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8aff0-28a2-40cd-806b-adbf170387cd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.415622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:32.477562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.478486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.478782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.479079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.480314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.482379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.571318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1194/2348] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:32.575876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.590034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac50af-99ca-4f4b-9014-9192f9c1b6d1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.596242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.597079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.597517 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.597902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.598917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.600920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.622008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.633808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1155/2349] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:32.636282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cb26d-87dd-4b55-8c7d-ba2002cd4088 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.641908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.642971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.643364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.643709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] PATH_INFO: `/v3/projects/cb322becb7d24d509d6ec15921e6e3c3/users/cf67960aef8b4140b8c0381f253b5540/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.666808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb322becb7d24d509d6ec15921e6e3c3, user_id=cf67960aef8b4140b8c0381f253b5540, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.669995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.687835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1195/2350] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:32 2022] PUT /identity/v3/projects/cb322becb7d24d509d6ec15921e6e3c3/users/cf67960aef8b4140b8c0381f253b5540/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:32.691660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.704490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ec1d8-1ca0-4769-b41d-6c3183a1cadc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.772023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.772927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.773838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.774190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.775006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.776704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82b4e1-8a09-4f0a-a036-47329b876e45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.788740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1156/2351] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:32.793607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.809661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376b6c-515a-4bfb-949b-1f7e7e45d33d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.814999 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.817190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.817519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.817807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] PATH_INFO: `/v3/projects/cb322becb7d24d509d6ec15921e6e3c3/users/cf67960aef8b4140b8c0381f253b5540/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.819912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb322becb7d24d509d6ec15921e6e3c3, user_id=cf67960aef8b4140b8c0381f253b5540, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.822844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.833919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1196/2352] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:32 2022] PUT /identity/v3/projects/cb322becb7d24d509d6ec15921e6e3c3/users/cf67960aef8b4140b8c0381f253b5540/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:37.810321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60814b76-1e5b-446a-bb98-9c4256e44add None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.810957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60814b76-1e5b-446a-bb98-9c4256e44add None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.810957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60814b76-1e5b-446a-bb98-9c4256e44add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.842171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-60814b76-1e5b-446a-bb98-9c4256e44add None None] MFA Rules not processed for user `cf67960aef8b4140b8c0381f253b5540`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:37.843518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-60814b76-1e5b-446a-bb98-9c4256e44add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:37.933692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1157/2353] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:14:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:37.947650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:37.949404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.088872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f683a9-f534-4460-af3b-e1b5fec044d5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.094931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.095675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.096030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.096386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.163258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.167128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.168864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.181815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1197/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:38.390399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.391255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.391255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.464653 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:38.465999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.475709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.537914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1158/2355] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:14:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:38.588767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.590278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.696348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c3c4-b5c9-4e45-a6f3-9abd0f0b0c2d service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.703785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.704514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.704838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.705111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.715429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.717581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.727530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1198/2356] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:44.717445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:44.719009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:44.842604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5ad55-cba4-4007-9b27-800cdd51975a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:44.849563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:44.850696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:44.851355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:44.851894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] PATH_INFO: `/v3/users/ba979dcd6d54449ab6b9b44ea19e9125` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:44.853682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba979dcd6d54449ab6b9b44ea19e9125)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:44.855801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:44.917277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba979dcd6d54449ab6b9b44ea19e9125'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:44.918044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba979dcd6d54449ab6b9b44ea19e9125'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:44.926581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba979dcd6d54449ab6b9b44ea19e9125'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:44.937067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba979dcd6d54449ab6b9b44ea19e9125'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:44.937814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba979dcd6d54449ab6b9b44ea19e9125'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:44.965199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1159/2357] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:44 2022] DELETE /identity/v3/users/ba979dcd6d54449ab6b9b44ea19e9125 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:45.229490 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:45.249555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac054dd-683e-4ceb-901c-baf5fc675674 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:45.371703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:45.373082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.373365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.373661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] PATH_INFO: `/v3/projects/446ddb12331b48c49d611587faeb92ae` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.375362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=446ddb12331b48c49d611587faeb92ae)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:45.378007 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:45.439487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446ddb12331b48c49d611587faeb92ae', 'request_id': 'req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.447701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446ddb12331b48c49d611587faeb92ae', 'request_id': 'req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.454632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446ddb12331b48c49d611587faeb92ae', 'request_id': 'req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.463737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:45.482063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] The token cache is being invalidate because project 446ddb12331b48c49d611587faeb92ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:45.482458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.483195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.485173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1199/2358] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:45 2022] DELETE /identity/v3/projects/446ddb12331b48c49d611587faeb92ae => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:45.489351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:45.490899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:45.505639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653f495-6c74-4303-9c0c-11c614711263 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:45.544267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:45.576807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:45.577746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.578044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.578332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] PATH_INFO: `/v3/users/2b1bc95d74d848cca80b93cfe749da41` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.579683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1bc95d74d848cca80b93cfe749da41)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:45.581733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:45.640884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1bc95d74d848cca80b93cfe749da41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.641660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1bc95d74d848cca80b93cfe749da41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.649712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1bc95d74d848cca80b93cfe749da41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.659773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1bc95d74d848cca80b93cfe749da41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.660432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f428b82b-5392-46f8-a599-30185cd548eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1bc95d74d848cca80b93cfe749da41'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.679882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1160/2359] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:45 2022] DELETE /identity/v3/users/2b1bc95d74d848cca80b93cfe749da41 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:45.878097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:45.880135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:45.896027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a696-4a20-48fc-a87d-f33a5c5cf01d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:45.969404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:45.970731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.971192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.971811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] PATH_INFO: `/v3/projects/680317a64dd043c48eb10b92d718c804` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.973754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680317a64dd043c48eb10b92d718c804)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:45.982736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:46.053926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680317a64dd043c48eb10b92d718c804', 'request_id': 'req-93d42a41-64b9-4feb-9981-446680b25575'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.061627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680317a64dd043c48eb10b92d718c804', 'request_id': 'req-93d42a41-64b9-4feb-9981-446680b25575'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.068659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680317a64dd043c48eb10b92d718c804', 'request_id': 'req-93d42a41-64b9-4feb-9981-446680b25575'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.085278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] The token cache is being invalidate because project 680317a64dd043c48eb10b92d718c804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:46.086198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.087148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.089110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1200/2360] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:45 2022] DELETE /identity/v3/projects/680317a64dd043c48eb10b92d718c804 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:55.675844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:56.081994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:02.662003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.662500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.662740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.688545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:02.689195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.759092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1161/2361] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jun 20 06:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:02.772680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.774341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.875138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42a41-64b9-4feb-9981-446680b25575 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.880744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.881475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.881925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.882281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.892938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.895466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.909892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1201/2362] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:04.969853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.971550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.042549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c3e68-18d8-44c6-b0a3-9526b731c817 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.047253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.048190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.048468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.048745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] PATH_INFO: `/v3/users/d1e03bec18c849e79bf2ce04ea496f62` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.049997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e03bec18c849e79bf2ce04ea496f62)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.051942 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.097053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e03bec18c849e79bf2ce04ea496f62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.097785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e03bec18c849e79bf2ce04ea496f62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.105673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e03bec18c849e79bf2ce04ea496f62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.112784 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e03bec18c849e79bf2ce04ea496f62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.113400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-518d3997-d4d2-4273-96a7-5553650af412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e03bec18c849e79bf2ce04ea496f62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.130404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1162/2363] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:04 2022] DELETE /identity/v3/users/d1e03bec18c849e79bf2ce04ea496f62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.301037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.311925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5799d5-d037-4ae4-a41c-aa435541349f service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.370652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.371461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.371744 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.372020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] PATH_INFO: `/v3/projects/b23bb3e50977480db739a786dcf9827a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.373197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23bb3e50977480db739a786dcf9827a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.375133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.420908 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23bb3e50977480db739a786dcf9827a', 'request_id': 'req-92a39f52-ff31-4727-80e1-73674f9d8f18'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.427022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23bb3e50977480db739a786dcf9827a', 'request_id': 'req-92a39f52-ff31-4727-80e1-73674f9d8f18'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.433904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23bb3e50977480db739a786dcf9827a', 'request_id': 'req-92a39f52-ff31-4727-80e1-73674f9d8f18'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.446439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] The token cache is being invalidate because project b23bb3e50977480db739a786dcf9827a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:05.446729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.447348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-92a39f52-ff31-4727-80e1-73674f9d8f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:05.448912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1202/2364] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:05 2022] DELETE /identity/v3/projects/b23bb3e50977480db739a786dcf9827a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.453783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.454143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.454501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.473332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:05.474614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.492698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:05.534796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1163/2365] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:05.543770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.544063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.544344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.562985 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:05.564189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.572425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1203/2366] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:05.576487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.586147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4769b-6607-4325-ad92-d71fc3068708 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.590678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.591321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.591597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.591869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.592583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:05.592886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.594509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.606286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1164/2367] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:05.610368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.620144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3478c6-f962-40cf-a9a0-31fb6ad18e5b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.624903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.625530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.625818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.626094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.626791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.628701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.638464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:05.657126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1204/2368] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:05.659527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.671107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e5f7-1dff-4339-9dba-578d1c63fe52 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.728939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.729628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.729912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.730191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.730886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.732795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.752313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1165/2369] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:05.756437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.766911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f8f73-9df7-4cd8-9469-e8454f47a502 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.771939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.773325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.773638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.773921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.774646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.776255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.786662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1205/2370] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.791005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.806048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baca3fd-5f55-422e-a9f3-294eeeaad0c6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.810742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.811390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.811668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.811938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.812652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.814287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42520d07-2f85-4869-b6ef-16aa7bfd2f7b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.824463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1166/2371] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.828449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.838980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da92ac-1838-45b8-aeb7-871db6df50bd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.843580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.844440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.844717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.844992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] PATH_INFO: `/v3/projects/3d9136bfc8104016a1b4dfe46e72628e/users/ebc4d79dd09e4fc4877f06ef5122cea4/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.859738 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9136bfc8104016a1b4dfe46e72628e, user_id=ebc4d79dd09e4fc4877f06ef5122cea4, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.862420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.875429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1206/2372] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:05 2022] PUT /identity/v3/projects/3d9136bfc8104016a1b4dfe46e72628e/users/ebc4d79dd09e4fc4877f06ef5122cea4/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.885202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eccea-d0c1-443a-8026-b7088bf304c0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.885524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eccea-d0c1-443a-8026-b7088bf304c0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.885804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eccea-d0c1-443a-8026-b7088bf304c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.911992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-da9eccea-d0c1-443a-8026-b7088bf304c0 None None] MFA Rules not processed for user `ebc4d79dd09e4fc4877f06ef5122cea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:05.913833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-da9eccea-d0c1-443a-8026-b7088bf304c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.977343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1167/2373] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:05.988206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.989905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:06.047970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554257a-d918-4d6c-8189-5d54b8b1ace9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:06.051642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:06.052292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:06.052575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:06.052855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:06.061661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:06.063107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:06.072630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1207/2374] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:11.390485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ef76-85f6-4ddc-82cc-2dbd50038c09 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:11.390967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ef76-85f6-4ddc-82cc-2dbd50038c09 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:11.391079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ef76-85f6-4ddc-82cc-2dbd50038c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:11.408545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7192ef76-85f6-4ddc-82cc-2dbd50038c09 None None] MFA Rules not processed for user `6f577abe1ada45979d5cb550073ae6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:11.409813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7192ef76-85f6-4ddc-82cc-2dbd50038c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:11.422716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:11.465092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1168/2375] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:16.068016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:18.428930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:18.491216 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dd4b-2b67-4306-b5fa-3e875a5249ca service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:18.495859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:18.496746 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:18.497029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:18.497301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] PATH_INFO: `/v3/users/ebc4d79dd09e4fc4877f06ef5122cea4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:18.498527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc4d79dd09e4fc4877f06ef5122cea4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:18.500470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:18.554185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc4d79dd09e4fc4877f06ef5122cea4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:18.554755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc4d79dd09e4fc4877f06ef5122cea4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:18.567292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc4d79dd09e4fc4877f06ef5122cea4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:18.574321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc4d79dd09e4fc4877f06ef5122cea4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:18.581456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc4d79dd09e4fc4877f06ef5122cea4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:18.588019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1208/2376] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:18 2022] DELETE /identity/v3/users/ebc4d79dd09e4fc4877f06ef5122cea4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:18.592544 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:18.592998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:18.593414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:18.611583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:18.612782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:18.670951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1169/2377] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:18.680859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:18.682335 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:18.739208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd469-1b9f-4807-a7e4-1784a3a8da46 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:18.743013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:18.743651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:18.743935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:18.744218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:18.753411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:18.754852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428192-e14d-4e78-a53e-db710ad143dd service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:18.764868 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1209/2378] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:19.040753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.042310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.054715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e1366-930c-49cb-bf2e-03e17fde2400 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.061543 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.062509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.062917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.063278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] PATH_INFO: `/v3/projects/3d9136bfc8104016a1b4dfe46e72628e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.064528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9136bfc8104016a1b4dfe46e72628e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.067562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.119148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9136bfc8104016a1b4dfe46e72628e', 'request_id': 'req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.127305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9136bfc8104016a1b4dfe46e72628e', 'request_id': 'req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.133286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9136bfc8104016a1b4dfe46e72628e', 'request_id': 'req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.144180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] The token cache is being invalidate because project 3d9136bfc8104016a1b4dfe46e72628e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:19.144470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.145351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3131f6e9-962b-4ff1-9dbf-c9a6ad5ff485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.147139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1170/2379] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:19 2022] DELETE /identity/v3/projects/3d9136bfc8104016a1b4dfe46e72628e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:19.153107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.153418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.153701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.171471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:19.172662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.189845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:19.237663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1210/2380] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:19.246025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.246315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.246599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.266210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:19.267433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.275965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1171/2381] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:19.280136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.290321 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc007-1006-4b7a-a649-46569a3e613c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.295327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.295990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.296272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.296546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.297265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:19.297722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.299332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.312048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1211/2382] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:19.316428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.327001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e2823-f153-41a3-9439-0ad4068ed588 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.332116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.332793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.333081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.333354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.334090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.336199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.367208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1172/2383] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:19.368419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.379718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e580e-2733-43ab-832a-45064acd7fa3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.436409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.437072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.437351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.437648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.438328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.440230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.463766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1212/2384] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:19.468789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.479491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051cae1-12ed-4e13-a8e7-92850fc5df1e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.484172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.484830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.485112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.485404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.486159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.487766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.499445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1173/2385] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:19.503423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.514541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23a8b-fa6e-49a8-a8dc-d3a9e80f1079 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.519221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.520188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.520470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.520745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.521499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.523132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc8e4e-fefc-42a1-8e2d-50a95212c802 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.533110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1213/2386] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:19.537775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.547743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec28075-ff7a-4a48-8290-c48c03f88945 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.552473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.554060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.554336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.554633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] PATH_INFO: `/v3/projects/1ba89cb3b2bb4f76b45f5c4177c61190/users/49caab5fec0b427d9ad64b5b1608e54a/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.558370 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:19.571541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba89cb3b2bb4f76b45f5c4177c61190, user_id=49caab5fec0b427d9ad64b5b1608e54a, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.574502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.593077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1174/2387] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:19 2022] PUT /identity/v3/projects/1ba89cb3b2bb4f76b45f5c4177c61190/users/49caab5fec0b427d9ad64b5b1608e54a/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:19.656192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49440-e618-4b58-998b-68b026698272 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.656492 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49440-e618-4b58-998b-68b026698272 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.656776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49440-e618-4b58-998b-68b026698272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.684604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-88e49440-e618-4b58-998b-68b026698272 None None] MFA Rules not processed for user `49caab5fec0b427d9ad64b5b1608e54a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:19.685838 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-88e49440-e618-4b58-998b-68b026698272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.748470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1214/2388] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:19.759239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.760904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.816723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668892-fb58-44d6-844d-ede8d6b7ec74 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.820464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.821094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.821392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.821679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.829875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.831291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.840484 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1175/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:29.745568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:29.836241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:40.338771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e49440-e618-4b58-998b-68b026698272 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:40.340191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-88e49440-e618-4b58-998b-68b026698272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:40.404001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e49440-e618-4b58-998b-68b026698272 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:40.407865 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:40.408516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:40.408797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:40.409080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:40.410927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:40.474988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:40.476432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afddbc-ffe7-4697-a05d-830b47d701f9 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:40.485893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1215/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:43.228618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:43.293443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434e3cd-9016-4471-8c77-e31658c6fbfa service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:43.298127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:43.299032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:43.299309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:43.299582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] PATH_INFO: `/v3/users/49caab5fec0b427d9ad64b5b1608e54a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:43.300774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49caab5fec0b427d9ad64b5b1608e54a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:43.303421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:43.350848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49caab5fec0b427d9ad64b5b1608e54a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.351503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49caab5fec0b427d9ad64b5b1608e54a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.358427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49caab5fec0b427d9ad64b5b1608e54a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.365585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49caab5fec0b427d9ad64b5b1608e54a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.366198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49caab5fec0b427d9ad64b5b1608e54a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.383501 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1176/2391] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:43 2022] DELETE /identity/v3/users/49caab5fec0b427d9ad64b5b1608e54a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:43.389679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:43.390168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:43.390351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:43.408288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:43.409539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:43.468706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1216/2392] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:43.479454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:43.480855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:43.539419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ed8fe-37fb-498f-a183-0b3939e67340 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:43.543135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:43.543775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:43.544087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:43.544365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:43.553881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:43.555309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684e14-b5c8-4e7b-8753-5282666c7d2b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:43.565205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1177/2393] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:43.838979 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:43.840439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:43.854024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0607d-f2be-4ed6-9d2e-b648adb3ed78 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:43.858635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:43.859517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:43.859816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:43.860090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] PATH_INFO: `/v3/projects/1ba89cb3b2bb4f76b45f5c4177c61190` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:43.861267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba89cb3b2bb4f76b45f5c4177c61190)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:43.864390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:43.910206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:43.913843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba89cb3b2bb4f76b45f5c4177c61190', 'request_id': 'req-49f5511e-f25c-4f55-933c-27390e2f58e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.919674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba89cb3b2bb4f76b45f5c4177c61190', 'request_id': 'req-49f5511e-f25c-4f55-933c-27390e2f58e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.925803 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba89cb3b2bb4f76b45f5c4177c61190', 'request_id': 'req-49f5511e-f25c-4f55-933c-27390e2f58e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.938648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] The token cache is being invalidate because project 1ba89cb3b2bb4f76b45f5c4177c61190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:43.938939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.939568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:43.941105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1217/2394] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:43 2022] DELETE /identity/v3/projects/1ba89cb3b2bb4f76b45f5c4177c61190 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:48.459074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:48.459564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:48.459656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:48.477039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] MFA Rules not processed for user `ee7405c2b1504907ba919e2797e63754`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:48.478277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:48.495229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:48.536137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1178/2395] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:15:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:53.935604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:58.529485 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:26.191099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:26.192892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:26.267459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5511e-f25c-4f55-933c-27390e2f58e4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:26.273209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:26.273884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:26.274169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:26.275030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:26.276820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:26.339855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:26.341499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:26.350503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1218/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:26.401861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:26.403345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:26.459608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e77e5c-6d9a-4cf0-b5bf-9a3e1ce151e9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:26.464238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:26.464875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:26.465152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:26.465454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:26.467193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:26.480592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:26.482032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:26.492736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1179/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:34.276499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:34.277982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.289682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037218-4f45-4339-87f9-499f7fe7a856 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:34.293497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:34.294135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:34.294422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:34.294702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:34.296433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.310367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:34.311807 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:34.323573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1219/2398] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:34.502893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:34.504333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.567887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9972-6e46-4a19-a666-d6b006ff4914 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:34.571635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:34.572766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:34.573053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:34.573332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:34.575175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.585046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:34.586527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e1ab2-842f-489d-805d-eb414537f989 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:34.595870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1180/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:40.141762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:40.143232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:40.157928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41bc1-1d5e-4f3b-8cff-055710b6f394 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:40.163519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:40.164179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:40.164464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:40.164743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:40.167330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:40.226136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:40.227741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:40.237338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1220/2400] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:44.591899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=52 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:49.775309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c2836-c75c-4927-87fe-da3dec0153fc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:49.775934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c2836-c75c-4927-87fe-da3dec0153fc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:49.775934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c2836-c75c-4927-87fe-da3dec0153fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:49.793688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5d2c2836-c75c-4927-87fe-da3dec0153fc None None] MFA Rules not processed for user `f49340b89c2a43b288572263ddac7be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:49.794868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5d2c2836-c75c-4927-87fe-da3dec0153fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:49.801683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1181/2401] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:50.232712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:56.153450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:56.167448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec9be-70be-4e3e-9f9e-49cb4fee69cc service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:56.173458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:56.174114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:56.174398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:56.174679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:56.176485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:56.189725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:56.191349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:56.202977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1221/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:59.788360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:06.197619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:32.486461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:32.486988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:32.486988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:32.504237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] MFA Rules not processed for user `ee7405c2b1504907ba919e2797e63754`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:32.505456 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:32.513024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1182/2403] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:32.816096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:32.817577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:32.834840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45860-ecdb-44cf-800d-82ecf5ed370d service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:32.838781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:32.839433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:32.839718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:32.839996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:32.841853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:32.851826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:32.853317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:32.861408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1222/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:34.190531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:34.191929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:34.263855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff57e-70b2-4b83-b18c-4be523d399e6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:34.268915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:34.269922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:34.270226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:34.270502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:34.272315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:34.284621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:34.286255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbdc64-4f45-470d-968d-7d0cdcdb62d1 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:34.297052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1183/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:42.857844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:44.292616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=35 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:44.518639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:44.535558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33e9c-a996-4a23-9c8f-7e29fc42ab0b service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:44.542211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:44.543341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:44.543688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:44.544033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:44.546049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:44.560096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:44.561758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:44.573203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1223/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:54.568319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:02.282640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:02.283187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:02.283187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:02.301571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] MFA Rules not processed for user `14bf1845390b4c7880c04ae568aea00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:02.302774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:02.310717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1184/2407] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:07.449479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:07.473037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1ab1-98ba-439c-8358-d869269cfc3f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:07.480841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:07.481811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:07.482574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:07.483077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:07.485272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:07.507168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:07.508896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:07.543059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1224/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:18:08.055982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:08.067008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bc763-8b48-4a3f-b3f9-c3c297951610 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:08.071639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:08.072969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:08.073257 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:08.073654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:08.075455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:08.155740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:08.157215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:08.169194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1185/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:11.599683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:11.619151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088557a-c871-464d-94e4-a66f164d531a service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:11.632427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:11.633086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:11.633370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:11.633697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:11.636165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:11.648872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:11.650620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:11.661199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1225/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:11.707557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:11.709185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:11.722492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b99a0-0408-49ad-a32b-244c5a3a6fd2 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:11.727452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:11.728390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:11.728688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:11.728968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] PATH_INFO: `/v3/users/f49340b89c2a43b288572263ddac7be8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:11.730196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49340b89c2a43b288572263ddac7be8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:11.732142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:11.779616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49340b89c2a43b288572263ddac7be8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.780252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49340b89c2a43b288572263ddac7be8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.786940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49340b89c2a43b288572263ddac7be8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.793917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49340b89c2a43b288572263ddac7be8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.794561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5e00040e-d700-4113-abbf-18dd1ead9332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49340b89c2a43b288572263ddac7be8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.812262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1186/2411] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:18:11 2022] DELETE /identity/v3/users/f49340b89c2a43b288572263ddac7be8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:18:11.998698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.013489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56ddb-b77c-4c46-94e1-abd22d3fbab7 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.070642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.071498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.072340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.072709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] PATH_INFO: `/v3/projects/0614a239ccf84b5da75a269f3a0c6363` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.073975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0614a239ccf84b5da75a269f3a0c6363)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.075925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.121736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0614a239ccf84b5da75a269f3a0c6363', 'request_id': 'req-2996ba11-21b6-49af-9602-c8eb9571729c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:12.127093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0614a239ccf84b5da75a269f3a0c6363', 'request_id': 'req-2996ba11-21b6-49af-9602-c8eb9571729c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:12.133262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0614a239ccf84b5da75a269f3a0c6363', 'request_id': 'req-2996ba11-21b6-49af-9602-c8eb9571729c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:12.146811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] The token cache is being invalidate because project 0614a239ccf84b5da75a269f3a0c6363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:18:12.147097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:12.147714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2996ba11-21b6-49af-9602-c8eb9571729c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:12.153475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1226/2412] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:18:11 2022] DELETE /identity/v3/projects/0614a239ccf84b5da75a269f3a0c6363 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:18:12.155495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.155781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.156055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.175004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:12.176210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:12.228317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:12.244490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1187/2413] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:12.246544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.246922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.247199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.266889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:12.268187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:12.277660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1227/2414] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:12.281935 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.292179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359218d-d1d9-427d-87e0-99983d1be9d0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.296779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.297464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.297752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.298033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.298797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:18:12.299104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.300705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.313002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1188/2415] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:18:12.317274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.327358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1e9c-fbb1-4c87-acad-bb87824f3132 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.332104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.332751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.333031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.333303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.334017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.335910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.378372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1228/2416] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:18:12 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:18:12.382374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.393138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a691522-0be9-4e8b-b4d8-73c50527e062 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.455528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.456193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.456474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.456746 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.457482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.459380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.481551 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1189/2417] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:18:12 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:18:12.485524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.496481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30d67c-a3fc-4d99-91c9-5fa50047f260 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.501691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.502442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.502796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.503149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.504076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.506062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.518168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1229/2418] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:18:12.522528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.533545 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d116c-4938-442d-b5df-7eb311b88440 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.539068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.540232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.540727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.541008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.541797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.543598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299da0-2523-43ca-9765-64871191ead0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.555166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1190/2419] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:18:12.560423 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.571026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e449-f844-4d51-a2e9-671cc6d11eba admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.577235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.578155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.578432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.578717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] PATH_INFO: `/v3/projects/8a2203406ec34776ab1a1e663601baaf/users/5fc0e8fe250349d699ea43aeee98170e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.591801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:12.595811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2203406ec34776ab1a1e663601baaf, user_id=5fc0e8fe250349d699ea43aeee98170e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.599910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.620804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1230/2420] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:18:12 2022] PUT /identity/v3/projects/8a2203406ec34776ab1a1e663601baaf/users/5fc0e8fe250349d699ea43aeee98170e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:18:12.625765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8b6a-2ff1-4e0b-bf8e-383e965b307c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.626175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8b6a-2ff1-4e0b-bf8e-383e965b307c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.626554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8b6a-2ff1-4e0b-bf8e-383e965b307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.647028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f7fd8b6a-2ff1-4e0b-bf8e-383e965b307c None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:12.648239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f7fd8b6a-2ff1-4e0b-bf8e-383e965b307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:12.709085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1191/2421] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:12.718810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:12.720886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:12.782496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b933ed-dda0-4667-bcc3-919fe7ea8c1f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:12.788138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:12.788857 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:12.789144 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:12.789453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:12.799658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:12.801097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:12.811444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1231/2422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:15.164137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbae33-baee-4181-b482-d6d4134914c4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:15.165051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbae33-baee-4181-b482-d6d4134914c4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:15.166969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbae33-baee-4181-b482-d6d4134914c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:15.196014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-78bbae33-baee-4181-b482-d6d4134914c4 None None] MFA Rules not processed for user `6f577abe1ada45979d5cb550073ae6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:15.197924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-78bbae33-baee-4181-b482-d6d4134914c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:15.354703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1192/2423] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:15.967341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:15.968954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:15.992056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816338-19a8-4947-95b5-52ecdfe4b02f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:16.005228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:16.006033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:16.006209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:16.006485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:16.009820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:16.024081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:16.026117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:16.035952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1232/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:18.408945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7646-93a5-46cd-bef5-06e166914c91 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:18.410455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7646-93a5-46cd-bef5-06e166914c91 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:18.410766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7646-93a5-46cd-bef5-06e166914c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:18.442968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:18.456092 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5eed7646-93a5-46cd-bef5-06e166914c91 None None] MFA Rules not processed for user `5fc0e8fe250349d699ea43aeee98170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:18.458220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5eed7646-93a5-46cd-bef5-06e166914c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:18.568910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1193/2425] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:18.585911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:18.587443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:18.693157 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c43d8-1af5-45f1-b0df-e240ee6908f1 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:18.699115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:18.699885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:18.700273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:18.700653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:18.710906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:18.712813 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:18.735225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1233/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:21.233814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5e76-6dee-4aed-a99b-2c6146187660 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:21.234309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5e76-6dee-4aed-a99b-2c6146187660 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:21.234620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5e76-6dee-4aed-a99b-2c6146187660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:21.256573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-26ef5e76-6dee-4aed-a99b-2c6146187660 None None] MFA Rules not processed for user `5fc0e8fe250349d699ea43aeee98170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:21.258573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-26ef5e76-6dee-4aed-a99b-2c6146187660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:21.268261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1194/2427] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:18:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:28.718966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:31.249274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=30 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:03.189925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:03.203414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7150c4-ee7b-4429-ba43-7080b756b3c7 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:03.209801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:03.210530 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:03.210882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:03.211213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:03.213247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:03.280146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:03.281790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:03.291258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1234/2428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:13.286839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=28 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:19.628824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:19.629410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:19.629410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:19.649523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] MFA Rules not processed for user `ee7405c2b1504907ba919e2797e63754`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:19.650721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:19.658597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1195/2429] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:29.643240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:01.800372 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.801900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.903717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d69bf-053f-4eb3-a227-49237d29622f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.908923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.909571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.909859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.910138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.912256 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.925238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.927029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.938331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1235/2430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:07.258282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:07.269823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed25af1-bcd2-45e0-a349-5d017d0b1da0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:07.274093 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:07.274857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:07.275208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:07.275524 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:07.277747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:07.292228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:07.294407 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:07.306137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1196/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:10.658921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.660481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.674268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce2d1-e446-4387-8624-b6c185536336 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.679442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.680089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.680371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.680647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.682509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.694736 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.696338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.710030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1236/2432] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:10.759050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.760622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.773168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ecf84-8436-4954-b8b7-97cc136cfe57 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.778953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.780260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.780577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.780897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] PATH_INFO: `/v3/users/14bf1845390b4c7880c04ae568aea00a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.782434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bf1845390b4c7880c04ae568aea00a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.784731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.841480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bf1845390b4c7880c04ae568aea00a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.842219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bf1845390b4c7880c04ae568aea00a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.851538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bf1845390b4c7880c04ae568aea00a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.861064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bf1845390b4c7880c04ae568aea00a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.862030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-023b6d01-4d57-4bb1-8fee-1af8504c0b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bf1845390b4c7880c04ae568aea00a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.879638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1197/2433] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:10 2022] DELETE /identity/v3/users/14bf1845390b4c7880c04ae568aea00a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:11.059161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.069970 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89bc6d-3510-4564-9c28-1b467d14c996 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.131015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.131879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.132167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.132444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] PATH_INFO: `/v3/projects/018cb579b1dd49db9062d4ddab9c9154` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.133674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018cb579b1dd49db9062d4ddab9c9154)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.135649 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.184023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018cb579b1dd49db9062d4ddab9c9154', 'request_id': 'req-ab77af2d-6d42-47da-83aa-9fd2c029b777'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.189610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018cb579b1dd49db9062d4ddab9c9154', 'request_id': 'req-ab77af2d-6d42-47da-83aa-9fd2c029b777'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.195758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018cb579b1dd49db9062d4ddab9c9154', 'request_id': 'req-ab77af2d-6d42-47da-83aa-9fd2c029b777'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.207890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] The token cache is being invalidate because project 018cb579b1dd49db9062d4ddab9c9154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:11.208177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.208831 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab77af2d-6d42-47da-83aa-9fd2c029b777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.210479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1237/2434] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/projects/018cb579b1dd49db9062d4ddab9c9154 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:11.215548 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.215834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.216112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.234500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:11.235694 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.296837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1198/2435] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:11.308486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.308929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.309276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.322266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.330828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:11.331947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.345544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1238/2436] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:11.349522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.363664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e46cc0-e201-4bbd-90fd-df5529af4e66 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.369200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.370559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.370834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.371291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.372050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:11.372358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.374276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.387451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1199/2437] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:11.392416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.403935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c89f1e-2f31-42ee-b3e5-e73d7ea731d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.408709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.409395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.409696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.409975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.410677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.412616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.443232 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1239/2438] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:11.451697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.462215 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e3ec2-f872-4b6d-802d-6dd68b3b674d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.509014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.528384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.529008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.529294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.529616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.530312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.532246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.551849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1200/2439] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:11.555998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.567993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768327-c581-4430-9e7d-6b17232b9b12 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.573310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.574074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.574516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.575413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.576142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.577817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.588564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1240/2440] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:11.592518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.602568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed2f5-75a3-44bf-b736-67cf06f4ffe3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.607804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.608453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.608730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.609003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.609761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.611347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857193a2-7d78-4cf8-917c-2b3e2a4b86ed admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.621870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1201/2441] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:11.625993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.636852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3db2d-2c50-496b-9f58-a7a4bb0df230 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.641579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.642447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.642733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.643012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] PATH_INFO: `/v3/projects/841c63c7bee6429986130b8a4a7022ab/users/841c6ad7c1be46ae911350a258635418/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.658136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841c63c7bee6429986130b8a4a7022ab, user_id=841c6ad7c1be46ae911350a258635418, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.660805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.678201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1241/2442] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:11 2022] PUT /identity/v3/projects/841c63c7bee6429986130b8a4a7022ab/users/841c6ad7c1be46ae911350a258635418/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:11.689895 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.690201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.690476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.718160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] MFA Rules not processed for user `841c6ad7c1be46ae911350a258635418`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:11.719382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.786532 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1202/2443] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:11.792343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.862851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cefb-0c27-4790-8548-fbdf7ad3b4f6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.868301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.869076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.869494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.869849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.870654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.872942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.902919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1242/2444] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:11.907157 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.918724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724ddb9-24c1-4290-8d42-f5dd676af405 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.977607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.978287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.978574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.978898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.979644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.981859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.003726 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1203/2445] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:12.007721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.020284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4ec1d-c884-412b-96ff-a5456de4bc41 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.025188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.026771 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.027127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.027398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.028121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.029836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.041346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1243/2446] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:12.046030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.056196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eb242-b43a-4c59-b54b-c56eef731c3a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.061118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.062023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.062311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.062592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] PATH_INFO: `/v3/projects/3140a503bdf54ce0a119ad9668917974/users/eccf708ee53b40edb3c7b8cfb8620906/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.080466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3140a503bdf54ce0a119ad9668917974, user_id=eccf708ee53b40edb3c7b8cfb8620906, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.083194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.099234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1204/2447] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:12 2022] PUT /identity/v3/projects/3140a503bdf54ce0a119ad9668917974/users/eccf708ee53b40edb3c7b8cfb8620906/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.103765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.117713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbfce0-5183-4ca1-ba23-36dcb950ac06 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.191892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.192789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.193180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.193604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.194548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.196710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbf28-083e-4281-8f8f-bee1b0a7e2f4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.210034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1244/2448] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:12.214230 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.224597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15af6e-86fe-496b-9f5d-10b072263f93 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.229490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.230365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.230646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.230923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] PATH_INFO: `/v3/projects/3140a503bdf54ce0a119ad9668917974/users/eccf708ee53b40edb3c7b8cfb8620906/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.232878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3140a503bdf54ce0a119ad9668917974, user_id=eccf708ee53b40edb3c7b8cfb8620906, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.235522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.246910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1205/2449] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:12 2022] PUT /identity/v3/projects/3140a503bdf54ce0a119ad9668917974/users/eccf708ee53b40edb3c7b8cfb8620906/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.257071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.257362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.257682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.282253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.285471 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] MFA Rules not processed for user `eccf708ee53b40edb3c7b8cfb8620906`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.287187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.357629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1245/2450] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:12.368733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.371526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.382647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.438681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c922-cbcb-49bc-85ae-af3e8ab2e857 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.442529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.443172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.443450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.443721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.455084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.456595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77489-a152-420b-b3ef-43a39fc486b4 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.467049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1206/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:12.620727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.692164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484f18-15a9-406e-8a93-d4a5ae45998b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.696919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.698115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.698449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.698852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] PATH_INFO: `/v3/users/841c6ad7c1be46ae911350a258635418` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.700092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841c6ad7c1be46ae911350a258635418)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.702069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.756623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841c6ad7c1be46ae911350a258635418'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.757509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841c6ad7c1be46ae911350a258635418'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.771049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841c6ad7c1be46ae911350a258635418'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.778819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841c6ad7c1be46ae911350a258635418'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.784526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.784809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.785224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.788175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6bf82033-7454-40fb-a103-6dbb1938da85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841c6ad7c1be46ae911350a258635418'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.796549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1246/2452] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:12 2022] DELETE /identity/v3/users/841c6ad7c1be46ae911350a258635418 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.801204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.801526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.801815 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.804626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.805879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.819764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.820963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.833006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.864979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1207/2453] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:12.886008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1247/2454] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:12.896128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.897578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.915916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.918185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.956989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8193-cd67-43a1-a3f5-143a65e09dab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.963655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.965866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.965866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.965866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.974969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.976411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.987112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1208/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:12.994983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481949cc-2eb5-4c7e-ad3b-189e23fe3760 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.000277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.000928 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.001211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.001523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.011298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.013373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.022501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1248/2456] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:20:13.299070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.301201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.316634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cf2ff-abae-4ca7-9cbc-25fed5be4856 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.322256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.323447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.323860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.324241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] PATH_INFO: `/v3/projects/841c63c7bee6429986130b8a4a7022ab` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.326024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841c63c7bee6429986130b8a4a7022ab)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.328105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.395351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841c63c7bee6429986130b8a4a7022ab', 'request_id': 'req-30b8f5a6-3ba8-4422-a1c7-a711328768f1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.398129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.409363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841c63c7bee6429986130b8a4a7022ab', 'request_id': 'req-30b8f5a6-3ba8-4422-a1c7-a711328768f1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.416622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841c63c7bee6429986130b8a4a7022ab', 'request_id': 'req-30b8f5a6-3ba8-4422-a1c7-a711328768f1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.427957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] The token cache is being invalidate because project 841c63c7bee6429986130b8a4a7022ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:13.428280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.428892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.430686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1209/2457] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:13 2022] DELETE /identity/v3/projects/841c63c7bee6429986130b8a4a7022ab => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.435193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.446120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f339-1520-4c4d-9c81-84e16f9a625e service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.524855 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.526740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.527171 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.527608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] PATH_INFO: `/v3/users/eccf708ee53b40edb3c7b8cfb8620906` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.528995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eccf708ee53b40edb3c7b8cfb8620906)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.531501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.613460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eccf708ee53b40edb3c7b8cfb8620906'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.614203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eccf708ee53b40edb3c7b8cfb8620906'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.616876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.633943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eccf708ee53b40edb3c7b8cfb8620906'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.642566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eccf708ee53b40edb3c7b8cfb8620906'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.657427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-741fb133-0df5-47ce-a399-ea09e7d8ff55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eccf708ee53b40edb3c7b8cfb8620906'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.668789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1249/2458] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:13 2022] DELETE /identity/v3/users/eccf708ee53b40edb3c7b8cfb8620906 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:14.120079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.121974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:14.153731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f5a6-3ba8-4422-a1c7-a711328768f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.233558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.234336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.234618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.234905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] PATH_INFO: `/v3/projects/3140a503bdf54ce0a119ad9668917974` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.236125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3140a503bdf54ce0a119ad9668917974)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.240060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.294468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3140a503bdf54ce0a119ad9668917974', 'request_id': 'req-f69ad7af-30e5-48e3-8802-df01eb05427a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:14.308921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3140a503bdf54ce0a119ad9668917974', 'request_id': 'req-f69ad7af-30e5-48e3-8802-df01eb05427a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:14.317340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3140a503bdf54ce0a119ad9668917974', 'request_id': 'req-f69ad7af-30e5-48e3-8802-df01eb05427a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:14.331857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] The token cache is being invalidate because project 3140a503bdf54ce0a119ad9668917974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:14.332161 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:14.332838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f69ad7af-30e5-48e3-8802-df01eb05427a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:14.334867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1210/2459] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:14 2022] DELETE /identity/v3/projects/3140a503bdf54ce0a119ad9668917974 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:14.339706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.340219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.340330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.362183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:14.365962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:14.443522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1250/2460] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:14.451075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.451601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.451882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.515172 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:14.516499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:14.533855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1211/2461] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:14.535327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.556499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7169-4562-4516-bb95-85cf3966e9df None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.564357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.565189 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.565619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.566000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.566858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:14.567276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.569411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.588376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1251/2462] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:14.589615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.600765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56555c51-6a91-4002-b4ec-cc4b16e0549e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.608777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.610328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.610614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.610894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.611604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.613611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.649338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1212/2463] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:14 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:14.654006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.666879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0ed9-9669-4cab-b7e2-781455e83a01 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.739333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.740442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.740907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.741192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.741944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.743897 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.781501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1252/2464] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:14 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:14.783152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.795237 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad8bc3-46d8-442a-b357-3b9287c97aff admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.800408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.801207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.804317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.804317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.804317 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.804970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.821754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1213/2465] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:14.823409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.835062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d53e2-a7bc-4457-b700-2e1580d43371 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.843672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.844520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.844809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.845092 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.846012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.847667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a292c-a9cb-49fb-9d21-5d0cf4091ad1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.860551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1253/2466] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:14.864227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.875866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4c49c-eb7b-4a3d-b242-3e3e6b3d183c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.880855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.881946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.882251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.882619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] PATH_INFO: `/v3/projects/22ef4ae894c142208d37760609409dd0/users/3361e0c3e6974812a2e55ffe3916037c/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.908225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ef4ae894c142208d37760609409dd0, user_id=3361e0c3e6974812a2e55ffe3916037c, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.911173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.944327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1214/2467] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:14 2022] PUT /identity/v3/projects/22ef4ae894c142208d37760609409dd0/users/3361e0c3e6974812a2e55ffe3916037c/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:14.945637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.946228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.946675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.981454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] MFA Rules not processed for user `3361e0c3e6974812a2e55ffe3916037c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:14.982887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:15.007888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:15.072900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1254/2468] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:15.075829 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.084937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:15.159709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d51-0bed-44cc-b99a-4bbf1af07ce9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.165624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.167088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.167377 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.167661 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.168643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.171387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.220743 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.221031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1215/2469] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:15 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:15.237604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233c28-05d9-494c-9898-4ba3176fb34f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.318685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.318685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.318685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.318685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.319301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.319442 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.351383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1255/2470] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:15 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:15.356206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.369702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3f2d8-51d1-4616-8581-c399ba2cd051 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.374755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.375510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.375803 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.376389 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.377134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.378923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.394001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1216/2471] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:15.395737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.408541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405e88-4066-4b54-a262-195aadee42e3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.413986 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.414889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.415195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.415686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] PATH_INFO: `/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c/users/d577b06e913946b794384398fcfcbd5b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.443123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44f3b6d572f4a1b8c460e3ae616959c, user_id=d577b06e913946b794384398fcfcbd5b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.445964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.467293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1256/2472] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:15 2022] PUT /identity/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c/users/d577b06e913946b794384398fcfcbd5b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:15.471985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.486566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceec9a-31b8-409c-8dca-b7ac3c42a45f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.570855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.571565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.571848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.572127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.572924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.574608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1ffdb-253b-4372-acef-4626ad343389 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.585402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1217/2473] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:15.590226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.600910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b5ee-c8a3-49b7-a8a5-6d4aec5f88f4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.606429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.607458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.607829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.608199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] PATH_INFO: `/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c/users/d577b06e913946b794384398fcfcbd5b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.611901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44f3b6d572f4a1b8c460e3ae616959c, user_id=d577b06e913946b794384398fcfcbd5b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.614713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.627182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1257/2474] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:15 2022] PUT /identity/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c/users/d577b06e913946b794384398fcfcbd5b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:15.649618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.650077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.650510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.687737 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] MFA Rules not processed for user `d577b06e913946b794384398fcfcbd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:15.689019 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:15.798158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1218/2475] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:15.812511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:15.814465 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:15.887491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434aabc-4e7d-425a-ba9c-2efc5e1df792 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:15.892405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:15.893203 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:15.893854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:15.894207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:15.906936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:15.908665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be39a5-fa03-41f1-b29a-52664636ef37 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:15.924173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1258/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:20:16.566906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:16.574977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:16.661454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368856-71df-4382-81d8-6b313aaf2c38 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:16.666367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:16.667518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:16.667876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:16.668231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] PATH_INFO: `/v3/users/3361e0c3e6974812a2e55ffe3916037c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:16.669570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3361e0c3e6974812a2e55ffe3916037c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:16.671622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:16.742250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3361e0c3e6974812a2e55ffe3916037c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:16.742930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3361e0c3e6974812a2e55ffe3916037c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:16.754665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3361e0c3e6974812a2e55ffe3916037c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:16.766436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3361e0c3e6974812a2e55ffe3916037c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:16.767668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3361e0c3e6974812a2e55ffe3916037c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:16.792342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1219/2477] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:16 2022] DELETE /identity/v3/users/3361e0c3e6974812a2e55ffe3916037c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:16.794788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:16.795310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:16.795403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:16.819539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:16.820835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:16.839847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:16.911267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1259/2478] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:16.923173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:16.924707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:16.989705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f567-88e4-49ce-8346-53ab796685fa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:16.993410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:16.994059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:16.995279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:16.995558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:17.005998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:17.007475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:17.020945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1220/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:17.372533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:17.374542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:17.401161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1d7d2-6fce-4e10-8f70-5373c9dea9d4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:17.407913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:17.408895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:17.409451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:17.409793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] PATH_INFO: `/v3/projects/22ef4ae894c142208d37760609409dd0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:17.411664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ef4ae894c142208d37760609409dd0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:17.413713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:17.472839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ef4ae894c142208d37760609409dd0', 'request_id': 'req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.480087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ef4ae894c142208d37760609409dd0', 'request_id': 'req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.488066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ef4ae894c142208d37760609409dd0', 'request_id': 'req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.504910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] The token cache is being invalidate because project 22ef4ae894c142208d37760609409dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:17.505209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.505903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.507749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1260/2480] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:17 2022] DELETE /identity/v3/projects/22ef4ae894c142208d37760609409dd0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:17.513555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:17.533932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80356d81-23cd-4ab7-ace4-5cfcdbe899f1 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:17.566121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:17.626898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:17.627896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:17.628248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:17.628722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] PATH_INFO: `/v3/users/d577b06e913946b794384398fcfcbd5b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:17.632095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d577b06e913946b794384398fcfcbd5b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:17.636068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:17.727747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd577b06e913946b794384398fcfcbd5b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.728360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd577b06e913946b794384398fcfcbd5b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.738210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd577b06e913946b794384398fcfcbd5b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.754246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd577b06e913946b794384398fcfcbd5b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.756113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fe49a333-138d-4dee-94f2-0ea285d5eb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd577b06e913946b794384398fcfcbd5b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:17.801473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1221/2481] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:17 2022] DELETE /identity/v3/users/d577b06e913946b794384398fcfcbd5b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:18.115016 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.117145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:18.157245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1017e-f8ee-4ff6-8afa-12b2110c68ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.231223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.232117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.232463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.232804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] PATH_INFO: `/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.234096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44f3b6d572f4a1b8c460e3ae616959c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.236095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.289958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:18.295987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44f3b6d572f4a1b8c460e3ae616959c', 'request_id': 'req-c0d1cc3d-56e5-4076-b070-e60e8ed89889'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.304974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44f3b6d572f4a1b8c460e3ae616959c', 'request_id': 'req-c0d1cc3d-56e5-4076-b070-e60e8ed89889'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.312941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44f3b6d572f4a1b8c460e3ae616959c', 'request_id': 'req-c0d1cc3d-56e5-4076-b070-e60e8ed89889'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.337628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] The token cache is being invalidate because project c44f3b6d572f4a1b8c460e3ae616959c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:18.338076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.339146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c0d1cc3d-56e5-4076-b070-e60e8ed89889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.341365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1261/2482] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:18 2022] DELETE /identity/v3/projects/c44f3b6d572f4a1b8c460e3ae616959c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:18.353707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.353997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.354277 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.376891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:18.378875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:18.461471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1222/2483] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:18.469692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.470284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.470671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.491730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:18.493025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:18.506296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1262/2484] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:18.508068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.521697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410a964-aef3-440e-977d-884dd0f3701d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.526854 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.527584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.527871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.528168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.528904 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:18.529216 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.530889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.545749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1223/2485] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:18.550166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.560701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f216d-daf6-4f20-a4a7-d68c64b3d57e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.565590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.566258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.566543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.566819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.567556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.569600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.601212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1263/2486] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:18.607075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.618066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f44f-c607-473a-846f-3d3684d3f8b0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.656660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:18.695351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.696061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.696376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.696636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.697432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.699864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.723927 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1224/2487] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:18.730499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.742129 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27895-7968-4240-ba0b-3847d052bec1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.747781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.748474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.748755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.749036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.749823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.751457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.763789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1264/2488] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:18.768115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.779505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4667da0-57d8-486c-9718-8ecc9300d9cf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.784578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.785359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.785672 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.786067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.786819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.788631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdabb4f-dd26-4c34-89aa-0b95aef906f4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.803495 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1225/2489] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:18.808185 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.818940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0ae8-adee-412e-9006-14d0b94721e5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.826476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.827827 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.828360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.828852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] PATH_INFO: `/v3/projects/283897cee4f74b36bc2bc621cb10edce/users/6fc141dff12046ae8e2daa2800c92f72/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.851292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283897cee4f74b36bc2bc621cb10edce, user_id=6fc141dff12046ae8e2daa2800c92f72, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.855274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.900001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1265/2490] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:18 2022] PUT /identity/v3/projects/283897cee4f74b36bc2bc621cb10edce/users/6fc141dff12046ae8e2daa2800c92f72/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:18.911166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.911763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.912108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.945440 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] MFA Rules not processed for user `6fc141dff12046ae8e2daa2800c92f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:18.947046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.058202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1226/2491] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:19.085927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.089211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.163484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddafef1-f420-4aed-935a-88f816bb70f3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.173570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.174531 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.174791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.175003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.187273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.188888 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d229bf5-0a0f-44f9-9a9d-c7de88356d05 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.203324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1266/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:19.222767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.302868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d33a79-3432-4a15-bb0e-d7c9357b9fa4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.308572 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.309540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.310147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.310433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] PATH_INFO: `/v3/users/6fc141dff12046ae8e2daa2800c92f72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.311709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc141dff12046ae8e2daa2800c92f72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.313706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.366603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:19.374133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc141dff12046ae8e2daa2800c92f72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.375305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc141dff12046ae8e2daa2800c92f72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.385604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc141dff12046ae8e2daa2800c92f72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.394378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc141dff12046ae8e2daa2800c92f72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.395140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc141dff12046ae8e2daa2800c92f72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.420213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1227/2493] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:19 2022] DELETE /identity/v3/users/6fc141dff12046ae8e2daa2800c92f72 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:19.422965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.423249 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.423552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.451536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:19.455828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.540608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1267/2494] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:19.551500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.553232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.629217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0845f-4add-4b1b-94c8-24fa5ccacc65 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.633311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.634311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.634669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.634950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.646373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.647822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b9bf0-7c29-4bc8-b66c-95eab8296b92 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.659125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1228/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:19.998881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.000467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.017287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1dd34-9267-4864-8f68-81c7894b8155 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.023456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.024470 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.024832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.025178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] PATH_INFO: `/v3/projects/283897cee4f74b36bc2bc621cb10edce` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.027240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283897cee4f74b36bc2bc621cb10edce)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.029421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.042905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:20.112580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283897cee4f74b36bc2bc621cb10edce', 'request_id': 'req-1114a3f0-74a6-4217-876f-b593986f0350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:20.128668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283897cee4f74b36bc2bc621cb10edce', 'request_id': 'req-1114a3f0-74a6-4217-876f-b593986f0350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:20.136184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283897cee4f74b36bc2bc621cb10edce', 'request_id': 'req-1114a3f0-74a6-4217-876f-b593986f0350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:20.156303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] The token cache is being invalidate because project 283897cee4f74b36bc2bc621cb10edce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:20.156632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:20.157264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1114a3f0-74a6-4217-876f-b593986f0350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:20.162259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1268/2496] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:19 2022] DELETE /identity/v3/projects/283897cee4f74b36bc2bc621cb10edce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:20.163915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.164205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.164541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.196245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.196245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.277165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1229/2497] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:20.279668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.280180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.280811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.303866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.305106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.330042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1269/2498] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:20.331831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.344390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38186c4-69b4-4bf5-91e4-3c2a26bec744 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.365809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.366696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.367146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.367421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.368434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:20.368743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.370759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.386207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1230/2499] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:20.391603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.414657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d6fd9-4c57-4cc1-81fe-ff1abc6c56a1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.420083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.421017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.421529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.422051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.422974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.424996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.458640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1270/2500] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.465327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.480139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3099e3-abfa-4079-ad7c-2f74cb8636b3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.540402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:20.561176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.561999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.562336 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.562675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.563534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.565565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.590547 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1231/2501] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.594266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.606934 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360cabd-6da3-440a-bdd6-135e61af26f2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.614111 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.614810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.615084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.615373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.616128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.617896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.634692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1271/2502] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.635994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.648316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f11bf-c00c-4435-9dcc-79b93f5b7d3e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.653776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.654451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.654731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.655009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.655742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.657349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582072-3401-4d4b-a851-c541fd76a5fc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.673960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1232/2503] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.675240 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.686053 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664c57-c74a-46f2-952e-47f4bc9e0517 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.691565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.692726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.693085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.693459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] PATH_INFO: `/v3/projects/837ee8094c024107a62e2cf9afcb9e87/users/8a4f7df26a614b55b732ca6774d5ec64/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.711430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] RBAC: Authorizing `identity:create_grant(project_id=837ee8094c024107a62e2cf9afcb9e87, user_id=8a4f7df26a614b55b732ca6774d5ec64, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.714886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.733098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1272/2504] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:20 2022] PUT /identity/v3/projects/837ee8094c024107a62e2cf9afcb9e87/users/8a4f7df26a614b55b732ca6774d5ec64/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:20.744176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4020e-ec1b-426f-a933-048021582c79 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.745130 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4020e-ec1b-426f-a933-048021582c79 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.747015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4020e-ec1b-426f-a933-048021582c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.777533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1ad4020e-ec1b-426f-a933-048021582c79 None None] MFA Rules not processed for user `8a4f7df26a614b55b732ca6774d5ec64`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.778763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ad4020e-ec1b-426f-a933-048021582c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.853438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1233/2505] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:20.867266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.869020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.940431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c451809-478e-423f-95a5-53b624b0217a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.944416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.945079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.945416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.945684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.956405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.957929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05a627-7619-489a-a4d7-83ca4d797f58 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.969358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1273/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:30.849932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:30.964552 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:34.009070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.009751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.009751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.011144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1234/2507] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:20:34.017489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831111bf-9413-424c-8523-68113728609a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.018120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831111bf-9413-424c-8523-68113728609a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.018120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831111bf-9413-424c-8523-68113728609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.059284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-831111bf-9413-424c-8523-68113728609a None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:34.060449 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-831111bf-9413-424c-8523-68113728609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.145608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1274/2508] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:20:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:34.154399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.156228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.246591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ded6-10e5-4ae1-b1c8-ab125933671f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:34.250454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:34.251111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.251394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.251670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.263499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:34.264951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cfb6f-0a25-4df3-a7d0-80daf10dc931 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:34.277983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1235/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:34.351101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.351306 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.351599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.353019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1275/2510] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:20:34.358167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eac42-32b5-477e-81ab-53f8de16722d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.358677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eac42-32b5-477e-81ab-53f8de16722d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.358982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eac42-32b5-477e-81ab-53f8de16722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.377498 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-081eac42-32b5-477e-81ab-53f8de16722d None None] MFA Rules not processed for user `de74d94d77fd4220a976184b587f389e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:34.378848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-081eac42-32b5-477e-81ab-53f8de16722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.436464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1236/2511] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:20:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:34.449159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.452250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.467268 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a7d04-faa7-4aee-951b-bbff8ce3e3d9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:34.471846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:34.472599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.472885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.473161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.482770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:34.484453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114492bf-b669-4a37-b676-e0fdb2478535 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:34.493388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1276/2512] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:34.590916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffc709-5183-424a-af48-17ed0945610b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.591272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffc709-5183-424a-af48-17ed0945610b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.591560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffc709-5183-424a-af48-17ed0945610b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.593033 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1237/2513] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jun 20 06:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:20:34.598882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec704-46be-442c-a24a-26d468415651 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.599222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec704-46be-442c-a24a-26d468415651 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.599519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec704-46be-442c-a24a-26d468415651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.620379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-327ec704-46be-442c-a24a-26d468415651 None None] MFA Rules not processed for user `115ba46eabce4863a597ad69bca1703c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:34.621684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-327ec704-46be-442c-a24a-26d468415651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.630825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1277/2514] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jun 20 06:20:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:34.641457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffc709-5183-424a-af48-17ed0945610b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.653454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffc709-5183-424a-af48-17ed0945610b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:34.657175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:34.657899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.658192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.658467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.669750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:34.671181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d04b6-2872-4840-9b69-2e003c9d6098 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:34.682184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1238/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:40.397182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ec704-46be-442c-a24a-26d468415651 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:40.409951 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ec704-46be-442c-a24a-26d468415651 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:40.416286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:40.417046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:40.417364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:40.417697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:40.419539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:40.479229 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:40.480682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:40.489963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1278/2516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:40.573796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:40.574408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:40.574408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:40.594908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:40.596164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:40.663772 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1239/2517] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:20:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:40.672932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:40.674933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:40.739133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:40.755909 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3b486-365b-45dc-858f-5db5ba128bf5 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:40.761723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:40.762373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:40.762659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:40.762942 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:40.771469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:40.773060 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e98b7-304d-4083-ad32-059afb6217f6 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:40.781222 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1279/2518] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:50.230518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:50.263940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:50.312594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90501-72c4-4f96-bddb-207a18535e7b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:50.317612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:50.318526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:50.318802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:50.319076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] PATH_INFO: `/v3/users/8a4f7df26a614b55b732ca6774d5ec64` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:50.320434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4f7df26a614b55b732ca6774d5ec64)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:50.322987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:50.382382 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4f7df26a614b55b732ca6774d5ec64'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:50.383245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4f7df26a614b55b732ca6774d5ec64'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:50.390985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4f7df26a614b55b732ca6774d5ec64'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:50.400716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4f7df26a614b55b732ca6774d5ec64'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:50.401500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4f7df26a614b55b732ca6774d5ec64'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:50.422985 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1240/2519] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:50 2022] DELETE /identity/v3/users/8a4f7df26a614b55b732ca6774d5ec64 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:50.435368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:50.435905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:50.436020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:50.454697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:50.456265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:50.517220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1280/2520] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:50.527570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:50.529078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:50.609763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12963-b756-4981-8051-5a2ab0f9b847 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:50.613622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:50.614287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:50.614564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:50.614841 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:50.627245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:50.628703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba599cc-71c0-4b76-b7b5-3b3f6434eee4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:50.640617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1241/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:50.970814 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:50.972435 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:50.988892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3751b-ccb8-4417-a969-8577d67c222e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:50.994463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:50.995340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:50.995628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:50.996000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] PATH_INFO: `/v3/projects/837ee8094c024107a62e2cf9afcb9e87` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:50.997147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837ee8094c024107a62e2cf9afcb9e87)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:50.999181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.062093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837ee8094c024107a62e2cf9afcb9e87', 'request_id': 'req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:51.068627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837ee8094c024107a62e2cf9afcb9e87', 'request_id': 'req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:51.076487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837ee8094c024107a62e2cf9afcb9e87', 'request_id': 'req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:51.092570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] The token cache is being invalidate because project 837ee8094c024107a62e2cf9afcb9e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:51.092971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:51.094371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b1e9481b-8b50-4b7f-a374-ab6ab10b2952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:51.097424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1281/2522] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:50 2022] DELETE /identity/v3/projects/837ee8094c024107a62e2cf9afcb9e87 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:51.100349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.100659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.100940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.124858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:51.126143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:51.168907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:51.188989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1242/2523] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:51.197011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.197301 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.197639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.216391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:51.217647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:51.229009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1282/2524] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:51.233085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.245588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5cb11-d0b0-4a62-a75a-163e409b56d7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.251621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.252302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.252586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.252924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.253714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:51.254038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.255861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.275610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1243/2525] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:51.276540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.292931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8ac9-e1ec-4718-9803-e2a403c0a2b8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.297923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.298608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.298885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.299155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.299847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.301802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.331188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1283/2526] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:51.335411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.346235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042046-9e8c-4613-ab24-bd127432cf7a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.404408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.405089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.405399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.405693 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.406388 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.408330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.429315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1244/2527] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:51.432926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.443426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebbce-f2f3-4eb3-9d72-f0a8791157be admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.448362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.449118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.449432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.449716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.450443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.452059 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.463524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1284/2528] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:20:51.467874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.479546 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789625-97d1-45ea-a1fb-d10a2e1cf7a1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.489564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.490416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.490808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.491192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.492040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.494549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca81300-e12e-4fe3-be96-22a3dd03f0af admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.506434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1245/2529] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:51.511288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.522250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b789-487b-4e98-98cd-1505a616449e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.527159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.528057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.528336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.543875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] PATH_INFO: `/v3/projects/44894ffbb6834c248f632b0afee0d990/users/182c91cd8e4a48a0959e61fca4701d62/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.561558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44894ffbb6834c248f632b0afee0d990, user_id=182c91cd8e4a48a0959e61fca4701d62, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.564347 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.587899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1285/2530] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:51 2022] PUT /identity/v3/projects/44894ffbb6834c248f632b0afee0d990/users/182c91cd8e4a48a0959e61fca4701d62/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:51.598536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.598842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.599115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.627898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] MFA Rules not processed for user `182c91cd8e4a48a0959e61fca4701d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:51.629136 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:51.694529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1246/2531] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:51.699219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.708458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:51.787086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b37828-f007-4b63-95a8-e68b15241260 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.792631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.793429 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.793792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.794147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.795052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.797075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.836922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1286/2532] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:51.838132 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.851593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8de4f6-e7ec-46f4-8b1b-758c63ad6348 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.893631 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:51.910928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.911600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.911884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.912160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.912849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.914855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.937256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1247/2533] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:51 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:51.941823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:51.956448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75447-22c5-41dd-84f1-cc93dfd36a34 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:51.971737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:51.972797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:51.973290 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:51.973801 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:51.974765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:51.976499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:51.998748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1287/2534] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:52.002470 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.022502 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2046-7043-4c86-b922-04e8ec888646 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.028460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.029280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.029817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.030315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.031150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.032868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a45d-3909-4277-be36-cc323759d273 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.044701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1248/2535] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:20:52.048996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.065515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c0775-4b2c-4dd7-be91-1a925410233e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.083557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.084460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.084745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.085027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] PATH_INFO: `/v3/projects/41dc4aa853c046838246d2675d454085/users/7b12ff1a3ecc49a68f5dce405cd94fe5/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.103740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41dc4aa853c046838246d2675d454085, user_id=7b12ff1a3ecc49a68f5dce405cd94fe5, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.106494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.120833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1288/2536] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:52 2022] PUT /identity/v3/projects/41dc4aa853c046838246d2675d454085/users/7b12ff1a3ecc49a68f5dce405cd94fe5/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:52.132358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.132655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.132966 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.161150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] MFA Rules not processed for user `7b12ff1a3ecc49a68f5dce405cd94fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:52.162404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:52.248192 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.249528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1249/2537] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:52.320252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b7a2-e434-4634-a99d-4e92262ebc02 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.325252 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.325933 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.326210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.326489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.327168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.329062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.356296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1289/2538] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:52 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:52.360474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.373286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f3aaa-4007-4dcb-90e9-63a07cd98ae1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.454733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.455576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.455893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.456201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.457112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.459508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.487864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1250/2539] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:52 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:52.489295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.502047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4996-8f3a-4026-915c-b2c4cbafa25d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.508122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.508859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.509265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.509580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.510311 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.512594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.525235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1290/2540] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:52.529363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.543719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813392-c58e-470d-a36e-696e77cfd567 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.561940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.563531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.563928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.564643 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] PATH_INFO: `/v3/projects/1100a1965710472d8030f5db23e1aabb/users/a5c10bda993e4254a51660917c6d3ea5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.589493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1100a1965710472d8030f5db23e1aabb, user_id=a5c10bda993e4254a51660917c6d3ea5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.591644 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.614582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1251/2541] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:52 2022] PUT /identity/v3/projects/1100a1965710472d8030f5db23e1aabb/users/a5c10bda993e4254a51660917c6d3ea5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:52.619011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.633156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c645-f028-4d62-8957-db52c8350e03 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.709861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:52.748379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.749353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.749835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.750281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.751237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.753271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1960c-e22a-48f4-bb2c-bcb2ecbbd32d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.769413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1291/2542] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:52.772851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.783903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbfc4-0a9d-477a-8493-a1a52d26097a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:52.788699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:52.789636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.790480 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.790760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] PATH_INFO: `/v3/projects/1100a1965710472d8030f5db23e1aabb/users/a5c10bda993e4254a51660917c6d3ea5/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.792766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1100a1965710472d8030f5db23e1aabb, user_id=a5c10bda993e4254a51660917c6d3ea5, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:52.795421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:52.811357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1252/2543] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:52 2022] PUT /identity/v3/projects/1100a1965710472d8030f5db23e1aabb/users/a5c10bda993e4254a51660917c6d3ea5/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:52.827103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:52.827103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:52.827103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:52.860180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] MFA Rules not processed for user `a5c10bda993e4254a51660917c6d3ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:52.862647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:52.974181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1292/2544] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:52.987525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:52.989898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:52.997838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:53.068883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337f22-cbda-48ee-b1b0-448d407166bb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:53.073612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:53.074344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:53.074691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:53.075051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:53.132764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:53.134775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba0b38-a637-4be4-9f12-d0ae4f223bd7 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:53.143744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1253/2545] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:55.737258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:55.738714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:55.752085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466773-4fb0-496b-b03d-4879478c2db0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:55.755679 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:55.756320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:55.756610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:55.756886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:55.782805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:55.783367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:55.783367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:55.800835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] MFA Rules not processed for user `6f577abe1ada45979d5cb550073ae6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:55.802077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:55.818790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:55.820472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:55.832215 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1293/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:55.861299 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1254/2547] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:56.392799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:56.404251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2741-25e0-446d-bdd0-8e212b5f243c service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:56.408120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:56.408789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:56.409202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:56.409527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:56.420654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:56.422265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4aa9-612c-497f-88d2-54125d4a3d8f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:56.433075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1294/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:00.386131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:00.490060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c294a-08f8-4891-8bde-c9712c187bef None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:00.495443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:00.496311 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:00.496590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:00.496862 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] PATH_INFO: `/v3/users/182c91cd8e4a48a0959e61fca4701d62` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:00.498064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=182c91cd8e4a48a0959e61fca4701d62)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:00.499997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:00.502972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:00.555817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182c91cd8e4a48a0959e61fca4701d62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:00.556730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182c91cd8e4a48a0959e61fca4701d62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:00.566511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182c91cd8e4a48a0959e61fca4701d62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:00.576885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182c91cd8e4a48a0959e61fca4701d62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:00.577692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182c91cd8e4a48a0959e61fca4701d62'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:00.604205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1255/2549] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:00 2022] DELETE /identity/v3/users/182c91cd8e4a48a0959e61fca4701d62 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:00.608765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:00.609224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:00.609554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:00.633087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:00.635479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:00.679498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:00.718187 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1295/2550] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:00.728437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:00.730198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:00.805936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38b6dc-2e48-4cb5-a8da-9a3e217bb27b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:00.811112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:00.811491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:00.811774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:00.812042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:00.823766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:00.825241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:00.835482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1256/2551] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:01.241684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:01.243901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:01.258320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd691d1-65fa-40bd-8287-23502402edbe None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:01.264048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:01.264930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:01.265217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:01.265565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] PATH_INFO: `/v3/projects/44894ffbb6834c248f632b0afee0d990` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:01.266784 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44894ffbb6834c248f632b0afee0d990)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:01.269019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:01.324334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44894ffbb6834c248f632b0afee0d990', 'request_id': 'req-db1dd11a-92b0-4c7e-837c-10cfb960704e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.330448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44894ffbb6834c248f632b0afee0d990', 'request_id': 'req-db1dd11a-92b0-4c7e-837c-10cfb960704e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.337353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44894ffbb6834c248f632b0afee0d990', 'request_id': 'req-db1dd11a-92b0-4c7e-837c-10cfb960704e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.349753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] The token cache is being invalidate because project 44894ffbb6834c248f632b0afee0d990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:01.350046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.350668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.352759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1296/2552] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:01 2022] DELETE /identity/v3/projects/44894ffbb6834c248f632b0afee0d990 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:01.356796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:01.366365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8ddf-ab1c-45df-a874-8774c8323aa2 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:01.423288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:01.424149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:01.424424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:01.424698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] PATH_INFO: `/v3/users/7b12ff1a3ecc49a68f5dce405cd94fe5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:01.425907 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b12ff1a3ecc49a68f5dce405cd94fe5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:01.427861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:01.458098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:01.480972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b12ff1a3ecc49a68f5dce405cd94fe5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.481565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b12ff1a3ecc49a68f5dce405cd94fe5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.488578 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b12ff1a3ecc49a68f5dce405cd94fe5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.496625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b12ff1a3ecc49a68f5dce405cd94fe5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.497591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b12ff1a3ecc49a68f5dce405cd94fe5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.516198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1257/2553] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:01 2022] DELETE /identity/v3/users/7b12ff1a3ecc49a68f5dce405cd94fe5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:01.816786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:01.819291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:01.843579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd11a-92b0-4c7e-837c-10cfb960704e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:01.913054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:01.913954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:01.914239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:01.914676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] PATH_INFO: `/v3/projects/41dc4aa853c046838246d2675d454085` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:01.915853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41dc4aa853c046838246d2675d454085)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:01.917832 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:01.967892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41dc4aa853c046838246d2675d454085', 'request_id': 'req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.973949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41dc4aa853c046838246d2675d454085', 'request_id': 'req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.980981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41dc4aa853c046838246d2675d454085', 'request_id': 'req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.982929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:01.996225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] The token cache is being invalidate because project 41dc4aa853c046838246d2675d454085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:01.996516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.997143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:01.998737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1297/2554] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:01 2022] DELETE /identity/v3/projects/41dc4aa853c046838246d2675d454085 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:02.002817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.004240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:02.017763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7f02c-036f-4894-8367-3086c3089f70 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.074755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.075666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.075949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.076227 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] PATH_INFO: `/v3/users/a5c10bda993e4254a51660917c6d3ea5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.077455 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c10bda993e4254a51660917c6d3ea5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.079367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.130346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c10bda993e4254a51660917c6d3ea5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.131135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c10bda993e4254a51660917c6d3ea5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.140996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c10bda993e4254a51660917c6d3ea5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.151696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c10bda993e4254a51660917c6d3ea5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.152391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b532bbd3-6434-4752-9ebe-2369e17749ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c10bda993e4254a51660917c6d3ea5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.172206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1258/2555] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:02 2022] DELETE /identity/v3/users/a5c10bda993e4254a51660917c6d3ea5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:02.458969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.460654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:02.480329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d0c5-e0c7-4ecb-a6ed-d807644b32f9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.543526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.544308 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.544629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.544943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] PATH_INFO: `/v3/projects/1100a1965710472d8030f5db23e1aabb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.546758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1100a1965710472d8030f5db23e1aabb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.548923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.605973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1100a1965710472d8030f5db23e1aabb', 'request_id': 'req-06a4360c-af29-4f14-8a76-7fcf6cd2b455'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.613433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1100a1965710472d8030f5db23e1aabb', 'request_id': 'req-06a4360c-af29-4f14-8a76-7fcf6cd2b455'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.621160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1100a1965710472d8030f5db23e1aabb', 'request_id': 'req-06a4360c-af29-4f14-8a76-7fcf6cd2b455'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.636446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] The token cache is being invalidate because project 1100a1965710472d8030f5db23e1aabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:02.636796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.637525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-06a4360c-af29-4f14-8a76-7fcf6cd2b455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:02.639709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1298/2556] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:02 2022] DELETE /identity/v3/projects/1100a1965710472d8030f5db23e1aabb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:02.644722 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.645204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.645305 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.669757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:02.671026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:02.689973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:02.736328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1259/2557] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:02.744789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.745077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.745359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.765172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:02.766432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:02.778061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1299/2558] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:02.779223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.789088 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8183-e26b-417f-80d0-e34583688e90 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.795175 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.795779 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.796060 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.796335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.797064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:02.797372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.799004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.811952 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1260/2559] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:02.816172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.825702 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec3152-400d-4009-8af2-07a1681fd353 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.830446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.831083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.831366 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.831637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.832344 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.834288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.864415 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1300/2560] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:02 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:02.866131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.878195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474cb89-6278-4c73-bf20-69277b946628 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.935360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.936034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.936328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.936595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.937295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.939247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.959139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1261/2561] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:02 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:02.963453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:02.973790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176975-b511-4cf7-b319-ac13a4fe3c96 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:02.979180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:02.979836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:02.980122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:02.980401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:02.981127 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:02.982802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:02.994454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1301/2562] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:02.997995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:03.008085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c716b-50e7-4e1f-bc7d-12c2f455e583 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:03.012949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:03.013640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:03.013956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:03.014261 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:03.014996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:03.016598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc51-6f05-44d7-aa61-42e32a0aaa67 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:03.027931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1262/2563] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:03.032061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:03.043184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4886ed-464d-486b-9f72-782f5b9d0e48 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:03.048324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:03.049285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:03.049605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:03.049884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] PATH_INFO: `/v3/projects/ead10df30fd6467392c0bb8c2a32cc8c/users/257364b1aff64da49915c07aea538d18/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:03.066518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead10df30fd6467392c0bb8c2a32cc8c, user_id=257364b1aff64da49915c07aea538d18, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:03.069202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:03.085237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1302/2564] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:03 2022] PUT /identity/v3/projects/ead10df30fd6467392c0bb8c2a32cc8c/users/257364b1aff64da49915c07aea538d18/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:03.096309 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db946b-e92c-4149-881e-31813106bf66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:03.096605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db946b-e92c-4149-881e-31813106bf66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:03.096892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db946b-e92c-4149-881e-31813106bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:03.125558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-55db946b-e92c-4149-881e-31813106bf66 None None] MFA Rules not processed for user `257364b1aff64da49915c07aea538d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:03.126905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55db946b-e92c-4149-881e-31813106bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:03.195170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1263/2565] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:03.206729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:03.208541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:03.230244 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:03.268760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c22ec-8822-417a-9fd3-319f349c5cc2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:03.272440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:03.273091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:03.273394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:03.273673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:03.282929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:03.284379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:03.294145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1303/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:13.192067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:13.289774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=18 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:15.761253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:15.761787 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:15.761871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:15.781442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:15.782673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:15.841699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1264/2567] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jun 20 06:21:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:15.865279 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:15.867029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:15.941841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe48b-d9bf-453a-a16b-23d7cea1aa03 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:15.947693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:15.948341 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:15.948620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:15.948892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:15.958556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:15.959699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:15.970412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1304/2568] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:18.381877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:18.383778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:18.449197 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e926e-0c86-43fc-8d3e-af0d6d279a20 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:18.453553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:18.454300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:18.454675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:18.455010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:18.457035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:18.530873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:18.532312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:18.543171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1265/2569] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:25.966564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=32 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:28.537820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=75 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:33.184905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:33.186377 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:33.198642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa501fc-a440-4811-83e4-47f0d6d7be1d service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:33.202653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:33.203299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:33.203585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:33.203866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:33.205757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:33.280899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:33.282773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:33.296212 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1305/2570] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:35.819322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:35.821987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:35.836902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3e87-6eff-42a4-93ca-27885503d555 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:35.841519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:35.842243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:35.842583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:35.842977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:35.845165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:35.862174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:35.863595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:35.875166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1266/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:43.290708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=34 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:45.078835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:45.088947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d96876-5848-4ebf-ae7f-b2faa9d09a0b service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:45.092573 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:45.093218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:45.093550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:45.093834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:45.095615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:45.159659 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:45.161115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:45.170968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1306/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:45.870187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:48.211386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:48.212928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:48.227454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480beb7-c6cb-4bf1-b5bf-988418e51f5f service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:48.232531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:48.233424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.233715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.234011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] PATH_INFO: `/v3/users/ee7405c2b1504907ba919e2797e63754` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.235238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7405c2b1504907ba919e2797e63754)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:48.237167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:48.284992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7405c2b1504907ba919e2797e63754'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.285685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7405c2b1504907ba919e2797e63754'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.293040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7405c2b1504907ba919e2797e63754'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.301066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7405c2b1504907ba919e2797e63754'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.301781 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7dca21ab-88b7-486d-a3f1-c1faac3cdbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7405c2b1504907ba919e2797e63754'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.321478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1267/2573] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:48 2022] DELETE /identity/v3/users/ee7405c2b1504907ba919e2797e63754 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:48.507793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:48.519646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764957-3e90-4bc1-b906-9c08e3b0abed service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:48.580901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:48.581717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.581995 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.582263 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] PATH_INFO: `/v3/projects/fde00bac11024d898d6d87b8d2abc29e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.583444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde00bac11024d898d6d87b8d2abc29e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:48.585890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:48.634325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde00bac11024d898d6d87b8d2abc29e', 'request_id': 'req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.639817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde00bac11024d898d6d87b8d2abc29e', 'request_id': 'req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.646195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde00bac11024d898d6d87b8d2abc29e', 'request_id': 'req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.658862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] The token cache is being invalidate because project fde00bac11024d898d6d87b8d2abc29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:48.659151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.659764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f26b2fe3-6e5e-4fbe-aa64-e534492c3a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:48.661338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1307/2574] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:48 2022] DELETE /identity/v3/projects/fde00bac11024d898d6d87b8d2abc29e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:48.666903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.667185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.667493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.686054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:48.687253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:48.755756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1268/2575] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:48.763698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.763990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.764270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.785662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:48.787051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:48.795770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1308/2576] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:48.800179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:48.810892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98ee9d-a025-4d74-a8d1-131aa3334f57 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:48.816740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:48.816740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.817021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.817301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.818079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:48.818393 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:48.820553 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:48.832892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1269/2577] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:48.838300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:48.848365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614115f-2e88-413e-8c18-695bb8343833 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:48.857230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:48.857973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.858434 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.858672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.859273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:48.861208 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:48.877652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:48.893968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1309/2578] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:48 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:48.898706 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:48.909137 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f0e2-fa52-45a3-9378-f36e6c52888e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:48.967001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:48.967703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:48.967990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:48.968270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:48.968988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:48.970940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:48.977924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:48.992892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1270/2579] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:48 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:48.996991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.008314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091adbce-cf4c-408d-82c7-45c4053f7a69 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.013281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.013987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.014272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.014555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.015286 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.016906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.029828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1310/2580] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:49.033933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.045511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fd56-0227-4efa-a9f3-26215399bd93 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.050254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.051031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.051320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.051597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.052345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.054499 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea817a1-4a98-4802-b16a-5c709ab2bd61 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.066267 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1271/2581] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:49.071645 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.081741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3249326-538f-4429-b71c-1da664788ebb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.086561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.087363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.087704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.087983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] PATH_INFO: `/v3/projects/54023511410c4e259f8f33bc8a1849e5/users/e79cbb8209b4490eb07ff830ad9e9c36/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.105136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54023511410c4e259f8f33bc8a1849e5, user_id=e79cbb8209b4490eb07ff830ad9e9c36, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.108559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.123631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1311/2582] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:49 2022] PUT /identity/v3/projects/54023511410c4e259f8f33bc8a1849e5/users/e79cbb8209b4490eb07ff830ad9e9c36/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:49.134707 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.135085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.135402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.165748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] MFA Rules not processed for user `e79cbb8209b4490eb07ff830ad9e9c36`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:49.166975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:49.236585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1272/2583] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:49.248389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.250105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:49.326137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218d7c-d8ba-4e27-ac89-25ad7922d427 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.333104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.334079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.334379 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.334685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.344367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.346049 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a510d98-4e09-43af-998b-415a6ac5e782 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.356077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1312/2584] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:49.571151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.634279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20d494-295e-410a-929c-000dd25a5af3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.638804 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.639674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.640073 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.640360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] PATH_INFO: `/v3/users/e79cbb8209b4490eb07ff830ad9e9c36` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.641598 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79cbb8209b4490eb07ff830ad9e9c36)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.643814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.690522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79cbb8209b4490eb07ff830ad9e9c36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:49.691182 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79cbb8209b4490eb07ff830ad9e9c36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:49.698727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79cbb8209b4490eb07ff830ad9e9c36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:49.705972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79cbb8209b4490eb07ff830ad9e9c36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:49.706595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79cbb8209b4490eb07ff830ad9e9c36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:49.711986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:49.726406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1273/2585] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:49 2022] DELETE /identity/v3/users/e79cbb8209b4490eb07ff830ad9e9c36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:49.730931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.731414 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.731513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.749480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:49.750699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:49.810110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1313/2586] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:49.820322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:49.821868 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:49.879622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43cb20-5941-4ea6-b133-1c1a9ff182b5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:49.883930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:49.884640 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:49.884859 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:49.885139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:49.894633 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:49.896072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526cbd0-3284-4263-a304-40eef992c35f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:49.905720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1274/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:50.194912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.196542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:50.211138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8664-14b9-46bd-8a70-816673af3b38 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.216704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.217817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.218107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.218385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] PATH_INFO: `/v3/projects/54023511410c4e259f8f33bc8a1849e5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.219926 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54023511410c4e259f8f33bc8a1849e5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.221935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.266353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:50.274499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54023511410c4e259f8f33bc8a1849e5', 'request_id': 'req-62110a1e-9d04-4335-9d52-b0c611869c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:50.281272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54023511410c4e259f8f33bc8a1849e5', 'request_id': 'req-62110a1e-9d04-4335-9d52-b0c611869c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:50.288270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54023511410c4e259f8f33bc8a1849e5', 'request_id': 'req-62110a1e-9d04-4335-9d52-b0c611869c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:50.301432 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] The token cache is being invalidate because project 54023511410c4e259f8f33bc8a1849e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:50.301725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:50.302362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-62110a1e-9d04-4335-9d52-b0c611869c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:50.305243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1314/2588] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:50 2022] DELETE /identity/v3/projects/54023511410c4e259f8f33bc8a1849e5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:50.310593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.311119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.311246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.330150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:50.331869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:50.394149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1275/2589] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:50.403595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.404407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.404719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.424147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:50.425228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:50.433905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1315/2590] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:50.438251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.448241 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b932ce-f539-408f-bb4d-265254cb992a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.452833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.453526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.453814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.454096 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.454837 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:50.455154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.456762 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.469645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1276/2591] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:50.473781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.483907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3dfc2-39e8-46b8-b757-ea0bc790010d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.488577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.489253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.489575 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.489854 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.490572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.493036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.519048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1316/2592] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:50.523374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.533334 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813de90-8f54-4148-9649-51f00f2a5cb0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.591685 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.592346 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.592624 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.592912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.593605 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.595519 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.616896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1277/2593] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:50.621197 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.632151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256279e-c80e-4c67-8ec7-e9585c3860b1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.636994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.637687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.637974 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.638253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.638977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.640590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.651505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1317/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:50.655417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.665509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0766-4696-490e-bcc9-bdcde81aabcd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.670065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.670714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.670992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.671268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.671996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.673609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd8c8-d744-415c-8a31-a8799396b9a4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.674880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:50.685989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1278/2595] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:50.690013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.700958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659db25-951d-49a5-a5f7-3e4dfb511ad7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.705656 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.706524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.706802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.707076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] PATH_INFO: `/v3/projects/b9ba210be9ba401da8ffaace2206cafc/users/1c34fbe4b4bf46198f6db0175f35be82/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.721731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ba210be9ba401da8ffaace2206cafc, user_id=1c34fbe4b4bf46198f6db0175f35be82, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.724406 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.738388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1318/2596] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:50 2022] PUT /identity/v3/projects/b9ba210be9ba401da8ffaace2206cafc/users/1c34fbe4b4bf46198f6db0175f35be82/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:50.749785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d81c-2609-482a-a779-77370dd092ba None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.750080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d81c-2609-482a-a779-77370dd092ba None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.750365 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d81c-2609-482a-a779-77370dd092ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.777739 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a197d81c-2609-482a-a779-77370dd092ba None None] MFA Rules not processed for user `1c34fbe4b4bf46198f6db0175f35be82`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:50.778951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a197d81c-2609-482a-a779-77370dd092ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:50.843169 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1279/2597] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:50.847611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.911138 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ab9b-2f0d-4874-82a4-5a7921b48689 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:50.916693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:50.917358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:50.917675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:50.917958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:50.918646 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:50.920564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:50.948572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1319/2598] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:50.952765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d81c-2609-482a-a779-77370dd092ba None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:50.964023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d81c-2609-482a-a779-77370dd092ba None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.020962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.021668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.021955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.022312 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.023005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.024932 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.045030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1280/2599] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:50 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:51.048883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.060652 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603549-817d-4781-b290-7ba333b614ae admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.065472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.066133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.066416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.066696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.067417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.069065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.077115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.078850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.083283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1320/2600] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:51.084217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.091385 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282261cf-9dc2-47fd-a0ec-e8cb3ba7ac7c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.094585 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06df37b-4607-494e-a21a-5b7f16f34302 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.096044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.096900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.097178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.097482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] PATH_INFO: `/v3/users/257364b1aff64da49915c07aea538d18` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.098660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257364b1aff64da49915c07aea538d18)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.099310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.100178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.101131 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.101446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.101562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] PATH_INFO: `/v3/projects/d249158cbe6648f1980c6cec73e3b94d/users/c0399b3983f34678beb440cb1c63a95c/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.118008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d249158cbe6648f1980c6cec73e3b94d, user_id=c0399b3983f34678beb440cb1c63a95c, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.120751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.136554 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1321/2601] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:51 2022] PUT /identity/v3/projects/d249158cbe6648f1980c6cec73e3b94d/users/c0399b3983f34678beb440cb1c63a95c/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:51.140638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.154108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257364b1aff64da49915c07aea538d18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.154874 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257364b1aff64da49915c07aea538d18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.159154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:51.162710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257364b1aff64da49915c07aea538d18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.171297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257364b1aff64da49915c07aea538d18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.171953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdc3a910-c3d6-45f5-8860-3efd426bd667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257364b1aff64da49915c07aea538d18'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.178171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:51.193076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1281/2602] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:51 2022] DELETE /identity/v3/users/257364b1aff64da49915c07aea538d18 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:51.198105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.199255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.199255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.222632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be776a1-c0ed-4d23-b484-a0dc30431b95 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.231428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:51.232648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.286680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.287349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.287634 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.288600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.289407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.291074 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.294901 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1282/2603] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:51.306063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1322/2604] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:51.306255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.307272 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.307585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.309409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.322250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ba86a-b4be-4c5f-84a8-0c76b4d97d91 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.327466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.328363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.328649 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.328930 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] PATH_INFO: `/v3/projects/d249158cbe6648f1980c6cec73e3b94d/users/c0399b3983f34678beb440cb1c63a95c/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.331167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d249158cbe6648f1980c6cec73e3b94d, user_id=c0399b3983f34678beb440cb1c63a95c, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.334243 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d125-186a-4b80-8dac-bac9d5382f31 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.346126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1323/2605] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:51 2022] PUT /identity/v3/projects/d249158cbe6648f1980c6cec73e3b94d/users/c0399b3983f34678beb440cb1c63a95c/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:51.356354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.356650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.356969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.374931 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45ae8e-045e-42c0-9eac-42f6d1084a02 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.386682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] MFA Rules not processed for user `c0399b3983f34678beb440cb1c63a95c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:51.387900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.425256 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.425853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.426142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.426425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.460241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1324/2606] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:51.473925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.475395 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.485959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:51.490102 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.493435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.502933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1283/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:51.514708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:51.540148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480527-b963-4bb5-ade5-751b9468c39f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.543880 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.544528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.544810 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.545091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.555546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.557087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de28e4-95a3-442c-9fd9-9eca597ae3d6 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.567752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1325/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:51.808249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.809870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.824975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cdb63-9649-435f-ac15-a88c6ed4537f service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:51.831016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:51.832055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.832410 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.832761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] PATH_INFO: `/v3/projects/ead10df30fd6467392c0bb8c2a32cc8c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.835273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead10df30fd6467392c0bb8c2a32cc8c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:51.837680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:51.895490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead10df30fd6467392c0bb8c2a32cc8c', 'request_id': 'req-2c793998-f162-46c4-a1a0-3504406ae540'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.904776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead10df30fd6467392c0bb8c2a32cc8c', 'request_id': 'req-2c793998-f162-46c4-a1a0-3504406ae540'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.911688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead10df30fd6467392c0bb8c2a32cc8c', 'request_id': 'req-2c793998-f162-46c4-a1a0-3504406ae540'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.924165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] The token cache is being invalidate because project ead10df30fd6467392c0bb8c2a32cc8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:51.924541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.925272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:51.927270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1284/2609] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:51 2022] DELETE /identity/v3/projects/ead10df30fd6467392c0bb8c2a32cc8c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:51.932393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2fd0-721e-4b7a-a56e-814f11c2c03f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:51.932859 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2fd0-721e-4b7a-a56e-814f11c2c03f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:51.933155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2fd0-721e-4b7a-a56e-814f11c2c03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:51.951922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-01fb2fd0-721e-4b7a-a56e-814f11c2c03f None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:51.953130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-01fb2fd0-721e-4b7a-a56e-814f11c2c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:51.981708 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:51.983170 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.017437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1326/2610] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:52.025795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.026114 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.026361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.046267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:52.047851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.054632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793998-f162-46c4-a1a0-3504406ae540 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.057527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1327/2611] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:52.059776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.060670 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.060924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.061079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.061343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] PATH_INFO: `/v3/users/1c34fbe4b4bf46198f6db0175f35be82` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.062611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c34fbe4b4bf46198f6db0175f35be82)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.064559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.071478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ab0a-b233-45af-b65e-de8f0c8c5bbe None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.076383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.077034 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.077318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.077625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.078346 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:52.078651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.080258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.093359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1328/2612] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:21:52.098598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.111276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f24a8-299d-4961-ae0a-352ddd73a202 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.116860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.117553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.117835 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.118106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.118796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.120058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c34fbe4b4bf46198f6db0175f35be82'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.120750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.120875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c34fbe4b4bf46198f6db0175f35be82'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.128968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c34fbe4b4bf46198f6db0175f35be82'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.138477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c34fbe4b4bf46198f6db0175f35be82'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.139260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a0abb116-d07b-4023-ade6-d144f468400b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c34fbe4b4bf46198f6db0175f35be82'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.147973 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1329/2613] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:52.152286 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:52.152463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.154056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.161780 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1285/2614] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:51 2022] DELETE /identity/v3/users/1c34fbe4b4bf46198f6db0175f35be82 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:52.166692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.167024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.167376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.189103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:52.191734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.222749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c67c7-43af-409b-8c7e-f327018ebfce admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.261113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1286/2615] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:52.268961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:52.271253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.272894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.290764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.291438 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.291723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.292057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.292794 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.294830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.320274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1330/2616] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:52.324725 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.335597 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b489d1d-bbfb-401b-be0a-049d9bd35fce None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.337991 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784fa9-5c9d-40a5-9a02-6e05a443e067 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.339298 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.339941 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.340218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.340491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.343695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.344528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.344883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.345206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.346098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.348013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.349924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.351387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.363117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1331/2617] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:52.363320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1287/2618] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:52.364262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.376209 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed4b6-56f6-46f9-b8e0-b483cc538de6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.382285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.383068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.383397 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.383691 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.384545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.386486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452a509-a32e-4fa4-967a-575ae247b354 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.400355 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1332/2619] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:52.404529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.414903 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956c7f-bf4d-4916-b43b-db8b49a79621 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.421222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.422351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.422752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.423435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] PATH_INFO: `/v3/projects/3d762030cc554c86ae18dbcc336c178f/users/d487babeb4234f0b91d2de76ebf81a24/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.441695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d762030cc554c86ae18dbcc336c178f, user_id=d487babeb4234f0b91d2de76ebf81a24, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.445089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.458603 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1288/2620] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:52 2022] PUT /identity/v3/projects/3d762030cc554c86ae18dbcc336c178f/users/d487babeb4234f0b91d2de76ebf81a24/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:52.470811 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.471099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.471391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.498754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] MFA Rules not processed for user `d487babeb4234f0b91d2de76ebf81a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:52.500154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.580557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1333/2621] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:52.593146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.595146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.641200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.642912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.680290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c068-7e5b-42df-85a1-49275fd3ab46 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.684319 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.685021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.685297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.685612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.696343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.697751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.707128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1289/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:52.728824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb8c99-9bcb-4cc5-8b14-aee125b47425 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.732268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.734083 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.734954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.735237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.735514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] PATH_INFO: `/v3/projects/b9ba210be9ba401da8ffaace2206cafc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.736727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ba210be9ba401da8ffaace2206cafc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.738686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.743683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ae3dc-c42a-49b8-bde5-7e3eb4f602ac service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.749235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.750140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.750430 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.750709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] PATH_INFO: `/v3/users/d487babeb4234f0b91d2de76ebf81a24` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.752314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d487babeb4234f0b91d2de76ebf81a24)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.754291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:52.768467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:52.783561 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:52.792954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ba210be9ba401da8ffaace2206cafc', 'request_id': 'req-a06ef919-8f66-47ff-ae56-a44859067ee4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.800495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ba210be9ba401da8ffaace2206cafc', 'request_id': 'req-a06ef919-8f66-47ff-ae56-a44859067ee4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.807478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ba210be9ba401da8ffaace2206cafc', 'request_id': 'req-a06ef919-8f66-47ff-ae56-a44859067ee4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.811760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd487babeb4234f0b91d2de76ebf81a24'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.812511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd487babeb4234f0b91d2de76ebf81a24'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.821821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] The token cache is being invalidate because project b9ba210be9ba401da8ffaace2206cafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:52.822100 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.822206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd487babeb4234f0b91d2de76ebf81a24'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.822732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.824427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1334/2623] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:52 2022] DELETE /identity/v3/projects/b9ba210be9ba401da8ffaace2206cafc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:52.828426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.830061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.831669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd487babeb4234f0b91d2de76ebf81a24'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.832474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-96695b1b-ec62-4eab-8b9e-f7bc3e31faf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd487babeb4234f0b91d2de76ebf81a24'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:52.853200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1290/2624] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:52 2022] DELETE /identity/v3/users/d487babeb4234f0b91d2de76ebf81a24 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:52.858110 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.858469 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.858776 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.879428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:52.880846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.896540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef919-8f66-47ff-ae56-a44859067ee4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:52.948140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1291/2625] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:52.954840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:52.955322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:52.955724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:52.955994 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:52.956264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] PATH_INFO: `/v3/users/c0399b3983f34678beb440cb1c63a95c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:52.956418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:52.957501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0399b3983f34678beb440cb1c63a95c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:52.959520 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.015981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0399b3983f34678beb440cb1c63a95c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.016665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0399b3983f34678beb440cb1c63a95c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.025700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc320d3-914f-4f61-8ed2-218af192cb79 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.029973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.030887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.031045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.031477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.031938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0399b3983f34678beb440cb1c63a95c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.040564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0399b3983f34678beb440cb1c63a95c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.043417 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:53.049826 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.052805 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0399b3983f34678beb440cb1c63a95c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.053451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.064756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1335/2626] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:52 2022] DELETE /identity/v3/users/c0399b3983f34678beb440cb1c63a95c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:53.071969 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1292/2627] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:53.452019 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.453508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.474611 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.476688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.495940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984c47-3387-4efc-b29e-b4bae19884df service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.532783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:53.543320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc234d-dba6-4e18-abc6-5a61c61b5ff4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.549167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.550093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.550381 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.550662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] PATH_INFO: `/v3/projects/d249158cbe6648f1980c6cec73e3b94d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.551899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d249158cbe6648f1980c6cec73e3b94d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.554494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.565035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.565943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.566231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.566510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] PATH_INFO: `/v3/projects/3d762030cc554c86ae18dbcc336c178f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.567744 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d762030cc554c86ae18dbcc336c178f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.570474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.606455 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd249158cbe6648f1980c6cec73e3b94d', 'request_id': 'req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.612195 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd249158cbe6648f1980c6cec73e3b94d', 'request_id': 'req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.620085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d762030cc554c86ae18dbcc336c178f', 'request_id': 'req-3881b3fe-ace7-48c0-9dee-74d31c5acb47'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.620273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd249158cbe6648f1980c6cec73e3b94d', 'request_id': 'req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.630953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d762030cc554c86ae18dbcc336c178f', 'request_id': 'req-3881b3fe-ace7-48c0-9dee-74d31c5acb47'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.633295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] The token cache is being invalidate because project d249158cbe6648f1980c6cec73e3b94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:53.633619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.634258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ba290dc-68e7-4fbb-a988-7dd04fb9ebc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.636072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1336/2628] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:53 2022] DELETE /identity/v3/projects/d249158cbe6648f1980c6cec73e3b94d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:53.638011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d762030cc554c86ae18dbcc336c178f', 'request_id': 'req-3881b3fe-ace7-48c0-9dee-74d31c5acb47'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.640758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5434-4bbe-4607-b0be-f3b98b9f7d8b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.641039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5434-4bbe-4607-b0be-f3b98b9f7d8b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.641315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5434-4bbe-4607-b0be-f3b98b9f7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.652563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] The token cache is being invalidate because project 3d762030cc554c86ae18dbcc336c178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:53.652852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.653562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3881b3fe-ace7-48c0-9dee-74d31c5acb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:53.655125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1293/2629] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:53 2022] DELETE /identity/v3/projects/3d762030cc554c86ae18dbcc336c178f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:53.659996 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424f-d748-4d68-8a80-3fea2ccf8bb9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.660302 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424f-d748-4d68-8a80-3fea2ccf8bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.660573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424f-d748-4d68-8a80-3fea2ccf8bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.661452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6a6e5434-4bbe-4607-b0be-f3b98b9f7d8b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:53.662703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6a6e5434-4bbe-4607-b0be-f3b98b9f7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.681246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7bac424f-d748-4d68-8a80-3fea2ccf8bb9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:53.682509 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7bac424f-d748-4d68-8a80-3fea2ccf8bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.723506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1337/2630] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:53.732591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.732889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.733175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.744435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1294/2631] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:53.752310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.752473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:53.752940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.753347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.753682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.762472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1338/2632] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:53.766248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.771986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:53.773805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:53.776767 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4d50-8ef0-4a59-b938-62d3e4da5c02 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.781360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.781860 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1295/2633] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:53.782032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.782312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.782588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.783303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:53.783604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.785207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.786053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.795802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464746-62a9-4c3a-b229-e6a9b02c6ba0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.800972 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1339/2634] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:21:53.801173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.801928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.802051 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.802212 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.802492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.803223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:53.803564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.805164 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.808405 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:53.812343 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f96d9-6256-406d-b324-6249559ce97b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.822600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1296/2635] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:53.822786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.822786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.822786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.822786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.823204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.823696 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.823815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.833696 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96d9-870f-43e3-94e3-672e3f11b8b4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.839268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.839929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.840217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.840497 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.841245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.843420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.852834 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1340/2636] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:53.856825 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.876541 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1297/2637] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:53.877882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.904973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:53.924317 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc334-a515-4547-9cdf-fd8fe736b06b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.944839 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0b19-2b34-4214-b888-ad9a9a540481 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.949799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.950477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.950758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.951039 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.951730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.953689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.977659 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1298/2638] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:53.978563 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:53.985411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.986076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.986386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.986637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.987326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.988753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731469cc-f979-4e79-a30f-56528be3e19f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:53.989274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:53.993676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:53.994330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:53.994615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:53.994896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:53.995627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:53.997221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.008669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1299/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:54.013422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1341/2640] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:53 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:54.013586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.014371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.024678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a3770-1a91-476b-a175-567539afdf5b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.025400 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c24b-baca-4f82-bced-41ee099dce86 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.029340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.030041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.030158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.030327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.030614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.030758 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.031031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.031347 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.031459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.032141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.032943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.033910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.047266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1300/2641] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:54.047453 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1342/2642] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:54.047983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.048178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.058165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e49ba-46ba-4fe7-a29f-9f56a6a2eebd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.059847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242ee45-2c3c-4267-915b-d0f68837b89b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.062979 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.063647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.063929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.064205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.064934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.065504 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.066392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.066561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.066665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.066937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] PATH_INFO: `/v3/projects/ef4cdcfeeefd4d598f28a1316087944f/users/0a38dccab9404882be501aeb64a228f6/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.078220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1301/2643] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:54.082206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.083267 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4cdcfeeefd4d598f28a1316087944f, user_id=0a38dccab9404882be501aeb64a228f6, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.086795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e2567-2a7f-4307-aea7-8891e3ea2cbe admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.093063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fcd2c-4e0a-462d-899f-b86b3514eb5a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.099331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.100688 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.101158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1343/2644] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:54 2022] PUT /identity/v3/projects/ef4cdcfeeefd4d598f28a1316087944f/users/0a38dccab9404882be501aeb64a228f6/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:54.101368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.101669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] PATH_INFO: `/v3/projects/0e96a4b5d1d64c7399cff9147cbf3cfd/users/b2397340dae144178ab687979ce72912/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.106213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.106517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.106779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.123896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e96a4b5d1d64c7399cff9147cbf3cfd, user_id=b2397340dae144178ab687979ce72912, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.124644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:54.125937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:54.127789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c302-a91b-4abd-a9f2-f50368205d79 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.143751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1302/2645] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:54 2022] PUT /identity/v3/projects/0e96a4b5d1d64c7399cff9147cbf3cfd/users/b2397340dae144178ab687979ce72912/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:54.157625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.158083 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.158390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.169149 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:54.186846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] MFA Rules not processed for user `b2397340dae144178ab687979ce72912`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:54.188084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:54.191404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1344/2646] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:54.201793 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.203190 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:54.258765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1303/2647] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:54.262757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56b9f-2c41-4050-b26c-a89c0d2ae3fd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.263201 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.312772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.313789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.314239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.314529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.315327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:54.331734 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c98d-03fc-4ffe-9a42-9bbfb59b4072 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.336539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.337203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.337520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.337799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.338549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.340464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.367119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1304/2648] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:54 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:21:54.371940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.385460 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.386927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.397113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1345/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:54.436148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b8b9-32ce-4741-9b41-0444d151aedf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.441196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.441908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.442196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.442479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.443211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.445825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.471621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1305/2650] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:54 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:54.476304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.487349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c1d3-3064-4138-a958-60bb79e2c95f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.493369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.494302 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.494528 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.494894 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.495627 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.497324 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.509075 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1346/2651] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:54.513337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.525181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669159-59c1-45a0-ab36-30b45aeb40db admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.530225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.531142 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.531439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.531761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] PATH_INFO: `/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437/users/094affcdd96f470dae23880921760839/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.549600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0ef8165ccc47369bbbb51b1c0f7437, user_id=094affcdd96f470dae23880921760839, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.552459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.567402 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1306/2652] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:54 2022] PUT /identity/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437/users/094affcdd96f470dae23880921760839/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:54.572325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.583236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072cf-b317-44bd-8b85-f64b9857c12f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.629116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:54.650976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.651658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.651944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.652225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.652961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.654619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee1e43-865a-4d04-855d-aca7a1e0f6a8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.664842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1347/2653] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:54.669238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.680857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8bab-c210-4739-9577-e9250029a02f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.686620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.687604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.687948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.688289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] PATH_INFO: `/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437/users/094affcdd96f470dae23880921760839/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.690413 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0ef8165ccc47369bbbb51b1c0f7437, user_id=094affcdd96f470dae23880921760839, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.693116 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.705306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1307/2654] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:54 2022] PUT /identity/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437/users/094affcdd96f470dae23880921760839/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:54.717740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.718065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.718487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.751161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] MFA Rules not processed for user `094affcdd96f470dae23880921760839`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:54.752529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:54.848732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1348/2655] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:54.860034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:54.861830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:54.923751 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e4b1-8bbe-4a23-b860-7221ad54808d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:54.928150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:54.929584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:54.929870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:54.930152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:54.939811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:54.941250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e310f8-89c6-4412-8bc2-c142a13c6163 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:54.951875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1308/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:54.980159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:55.057156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887dd93-8e6a-40f3-9d06-b9990953c405 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:55.060815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c7a8-7442-4c73-a7e8-261274666730 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.061104 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c7a8-7442-4c73-a7e8-261274666730 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.062045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c7a8-7442-4c73-a7e8-261274666730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.071491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:55.072437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.072722 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.072998 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] PATH_INFO: `/v3/users/b2397340dae144178ab687979ce72912` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.074448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2397340dae144178ab687979ce72912)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:55.076657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:55.093526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e007c7a8-7442-4c73-a7e8-261274666730 None None] MFA Rules not processed for user `0a38dccab9404882be501aeb64a228f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:55.096040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e007c7a8-7442-4c73-a7e8-261274666730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.113704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:55.136914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2397340dae144178ab687979ce72912'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.137858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2397340dae144178ab687979ce72912'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.157809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:55.159730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2397340dae144178ab687979ce72912'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.171135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2397340dae144178ab687979ce72912'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.183820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2397340dae144178ab687979ce72912'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.184288 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1309/2657] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:55.194513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1349/2658] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:54 2022] DELETE /identity/v3/users/b2397340dae144178ab687979ce72912 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:55.198830 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085a64-ad78-459c-92db-11843073612e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.199266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085a64-ad78-459c-92db-11843073612e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.199626 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085a64-ad78-459c-92db-11843073612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.200283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:55.201904 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.219981 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b085a64-ad78-459c-92db-11843073612e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:55.221358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b085a64-ad78-459c-92db-11843073612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.277663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ac20-2714-428c-9ea6-17def4ca29c2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:55.281271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:55.281977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.282264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.282542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.284360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.294604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1310/2659] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:55.304332 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085a64-ad78-459c-92db-11843073612e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:55.305723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b085a64-ad78-459c-92db-11843073612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.356947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:55.358571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:55.366248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085a64-ad78-459c-92db-11843073612e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:55.369445 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1350/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:55.369998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:55.370719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.371002 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.371279 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.381031 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:55.382999 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:55.392714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1311/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:55.694791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:55.696314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:55.720011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14a0be-08f9-4dab-b7f1-1ed476d8799e service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:55.725404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:55.727145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.727524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.727755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] PATH_INFO: `/v3/projects/0e96a4b5d1d64c7399cff9147cbf3cfd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.729768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e96a4b5d1d64c7399cff9147cbf3cfd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:55.731829 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:55.778253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e96a4b5d1d64c7399cff9147cbf3cfd', 'request_id': 'req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.783884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e96a4b5d1d64c7399cff9147cbf3cfd', 'request_id': 'req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.790907 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e96a4b5d1d64c7399cff9147cbf3cfd', 'request_id': 'req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.803281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] The token cache is being invalidate because project 0e96a4b5d1d64c7399cff9147cbf3cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:55.803579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.804198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.805762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1351/2662] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:55 2022] DELETE /identity/v3/projects/0e96a4b5d1d64c7399cff9147cbf3cfd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:55.809712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:55.819732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1fd0e-ed1b-42e4-9fb1-534005bdfb9e service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:55.870883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:55.876970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:55.877879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:55.878160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:55.878434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] PATH_INFO: `/v3/users/094affcdd96f470dae23880921760839` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:55.879620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094affcdd96f470dae23880921760839)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:55.881617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:55.929535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094affcdd96f470dae23880921760839'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.930179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094affcdd96f470dae23880921760839'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.937007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094affcdd96f470dae23880921760839'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.944566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094affcdd96f470dae23880921760839'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.945268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-210d5a11-2d5a-4f31-87ab-1a7e984544c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094affcdd96f470dae23880921760839'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:55.963301 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1312/2663] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:55 2022] DELETE /identity/v3/users/094affcdd96f470dae23880921760839 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:56.240101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.241683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.259752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddbc3d-a5dc-432d-9571-b6ce5fd4f167 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.274467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.318562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.320003 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.320282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.320562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] PATH_INFO: `/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.321783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0ef8165ccc47369bbbb51b1c0f7437)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.323703 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.371409 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0ef8165ccc47369bbbb51b1c0f7437', 'request_id': 'req-87ed35ed-1dc8-4944-8ba7-dff41b88c281'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:56.376664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0ef8165ccc47369bbbb51b1c0f7437', 'request_id': 'req-87ed35ed-1dc8-4944-8ba7-dff41b88c281'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:56.383545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0ef8165ccc47369bbbb51b1c0f7437', 'request_id': 'req-87ed35ed-1dc8-4944-8ba7-dff41b88c281'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:56.398598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] The token cache is being invalidate because project ba0ef8165ccc47369bbbb51b1c0f7437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:56.398890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:56.399783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-87ed35ed-1dc8-4944-8ba7-dff41b88c281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:56.401362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1352/2664] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:56 2022] DELETE /identity/v3/projects/ba0ef8165ccc47369bbbb51b1c0f7437 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:56.406476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.406764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.407070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.426457 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:56.427654 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.488472 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1313/2665] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:56.496745 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.497061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.497454 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.516385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:56.517625 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.526122 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1353/2666] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:56.530344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.541195 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59d05-5925-4b98-8f09-df11f9739629 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.545766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.546423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.546700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.546972 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.547691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:56.547990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.549617 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.562888 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1314/2667] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:56.567724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.577673 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b929d-fd76-40f4-8660-ba0b9e7e1560 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.582313 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.582955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.583237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.583512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.584238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.586230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.611587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1354/2668] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:56.616328 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.626641 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34804-0ebe-4ace-a3fa-3c5558821a39 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.684662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.685395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.685687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.686247 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.686951 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.688929 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.698783 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.715599 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1315/2669] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:56.716826 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.731773 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea6e3-d1cf-42a6-9f3b-61872481ec47 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.738823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.739495 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.739808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.740214 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.741612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.743288 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.759483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1355/2670] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:56.763642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.775205 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec6fa-86fb-4518-9f53-ec37a34b07fd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.780647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.781396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.781697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.781978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.782767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.784422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aa5ff-cc89-4e5c-b439-3f418e754e22 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.796662 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1316/2671] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:21:56.801071 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.805673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.805961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.806269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.812039 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3465a5-64de-41c7-8c7a-b437be7e0e7c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.816733 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.817668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.817948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.818221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] PATH_INFO: `/v3/projects/a619c37648024718a0ab0007a63ef97c/users/5b493269add8495b931e16c7ebe627e4/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.826232 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] MFA Rules not processed for user `0a38dccab9404882be501aeb64a228f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:56.827461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.833340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a619c37648024718a0ab0007a63ef97c, user_id=5b493269add8495b931e16c7ebe627e4, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.836082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720155c-f4c7-4772-a5ce-0df07e5dbc6b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.850870 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1356/2672] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:56 2022] PUT /identity/v3/projects/a619c37648024718a0ab0007a63ef97c/users/5b493269add8495b931e16c7ebe627e4/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:56.860891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.861180 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.861487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.887310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1317/2673] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:56.890713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] MFA Rules not processed for user `5b493269add8495b931e16c7ebe627e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:56.891950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.929992 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.968130 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1357/2674] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:56.972884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.985147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aaeb8-f52c-4ed3-8f81-11645572c0f8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.044518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.045211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.045527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.045805 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.046634 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.048540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.074727 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1318/2675] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:56 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:57.079529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.091523 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361fedb-cc31-4bf7-ad56-7a4fa52b7cb6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.154833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.155588 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.155941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.156287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.157097 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.159622 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.184011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1358/2676] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:57 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:57.188362 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.200812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d63559-f122-4b64-9674-9c5858487b58 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.205914 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.206588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.206875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.207770 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.208521 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.210339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.221800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1319/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:57.226258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.236591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991089-706d-43ac-8323-818af2d8527c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.242032 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.242944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.243228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.243506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] PATH_INFO: `/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3/users/76a4ce31adf14f9cbbc3e1854b54dc6d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.265529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=978af24d83c24c48acd0ed0ea6cb57c3, user_id=76a4ce31adf14f9cbbc3e1854b54dc6d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.268629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.282516 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1359/2678] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:57 2022] PUT /identity/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3/users/76a4ce31adf14f9cbbc3e1854b54dc6d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:57.286487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.296777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef4efd-99cd-49ce-9418-74aed050cb6d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.364922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.366351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.366665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.366943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.367710 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.369287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69d68a-c9b7-4346-bb09-95f58f7cdd0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.371877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:57.381029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1320/2679] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:21:57.386469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.397330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dc28-ace7-4fcd-af3d-61f959bcff0f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.402913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.403858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.404204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.404543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] PATH_INFO: `/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3/users/76a4ce31adf14f9cbbc3e1854b54dc6d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.406608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=978af24d83c24c48acd0ed0ea6cb57c3, user_id=76a4ce31adf14f9cbbc3e1854b54dc6d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.409328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.423968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1360/2680] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:21:57 2022] PUT /identity/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3/users/76a4ce31adf14f9cbbc3e1854b54dc6d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:57.436587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.436876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.437159 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.467269 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] MFA Rules not processed for user `76a4ce31adf14f9cbbc3e1854b54dc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:57.468575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:57.565428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1321/2681] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:57.575145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:57.576935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:57.639259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ae5b-b1e8-440b-b2ae-9576095adc3a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:57.643356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:57.644015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:57.644300 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:57.644586 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:57.655723 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:57.657103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6da97f-40fd-4f70-95ee-f6ce048e8f41 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:57.668822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1361/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:58.254079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:58.316632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69641-058a-4849-a917-f9f1fc8a8452 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:58.322278 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:58.323179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:58.323465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:58.323745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] PATH_INFO: `/v3/users/5b493269add8495b931e16c7ebe627e4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:58.324974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b493269add8495b931e16c7ebe627e4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:58.326922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:58.377233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b493269add8495b931e16c7ebe627e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:58.378041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b493269add8495b931e16c7ebe627e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:58.386483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b493269add8495b931e16c7ebe627e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:58.394955 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b493269add8495b931e16c7ebe627e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:58.395667 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b493269add8495b931e16c7ebe627e4'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:58.416568 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1322/2683] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:58 2022] DELETE /identity/v3/users/5b493269add8495b931e16c7ebe627e4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:58.420766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:58.421261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:58.421421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:58.440955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:58.442133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:58.468616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:58.510181 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1362/2684] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:58.520396 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:58.523425 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:58.534339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:58.610244 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117a1f-39ea-4246-b944-4256d545f52b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:58.614474 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:58.615211 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:58.615534 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:58.616007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:58.630038 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:58.632668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:58.646335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1323/2685] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:58.947067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:58.948796 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:58.964084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f181-66f3-441a-86f0-5e0770f72305 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:58.969845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:58.970763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:58.971116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:58.971708 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] PATH_INFO: `/v3/projects/a619c37648024718a0ab0007a63ef97c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:58.973101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a619c37648024718a0ab0007a63ef97c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:58.975467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.028717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a619c37648024718a0ab0007a63ef97c', 'request_id': 'req-70929da4-73b4-4fe6-bdfb-f3687c32d262'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.035964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a619c37648024718a0ab0007a63ef97c', 'request_id': 'req-70929da4-73b4-4fe6-bdfb-f3687c32d262'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.043642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a619c37648024718a0ab0007a63ef97c', 'request_id': 'req-70929da4-73b4-4fe6-bdfb-f3687c32d262'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.057872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] The token cache is being invalidate because project a619c37648024718a0ab0007a63ef97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:59.058596 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.059712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.062425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1363/2686] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:58 2022] DELETE /identity/v3/projects/a619c37648024718a0ab0007a63ef97c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:59.067387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.080621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581092c-ecf5-4c41-a8a7-a23d47cc0872 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:59.144274 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:59.145144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.145536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.145748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] PATH_INFO: `/v3/users/76a4ce31adf14f9cbbc3e1854b54dc6d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.147001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a4ce31adf14f9cbbc3e1854b54dc6d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:59.149098 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.207975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a4ce31adf14f9cbbc3e1854b54dc6d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.208678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a4ce31adf14f9cbbc3e1854b54dc6d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.216079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a4ce31adf14f9cbbc3e1854b54dc6d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.223987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a4ce31adf14f9cbbc3e1854b54dc6d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.224834 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a4ce31adf14f9cbbc3e1854b54dc6d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.245423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1324/2687] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:21:59 2022] DELETE /identity/v3/users/76a4ce31adf14f9cbbc3e1854b54dc6d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:21:59.549581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.551178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:59.566152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929da4-73b4-4fe6-bdfb-f3687c32d262 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:59.614713 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.616742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:59.630885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:59.632081 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.632533 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.632817 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] PATH_INFO: `/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.634329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978af24d83c24c48acd0ed0ea6cb57c3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:59.636314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.649560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:59.685589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5698-1493-4194-ad70-bc85b48d2125 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:59.687102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978af24d83c24c48acd0ed0ea6cb57c3', 'request_id': 'req-69b09c55-cc09-404a-9378-3d279f4512f8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.691098 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:59.693393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978af24d83c24c48acd0ed0ea6cb57c3', 'request_id': 'req-69b09c55-cc09-404a-9378-3d279f4512f8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.701006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978af24d83c24c48acd0ed0ea6cb57c3', 'request_id': 'req-69b09c55-cc09-404a-9378-3d279f4512f8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.719881 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] The token cache is being invalidate because project 978af24d83c24c48acd0ed0ea6cb57c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:21:59.720206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.720922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-69b09c55-cc09-404a-9378-3d279f4512f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:21:59.722542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1364/2688] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:21:59 2022] DELETE /identity/v3/projects/978af24d83c24c48acd0ed0ea6cb57c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:21:59.727577 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.727900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.728205 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.741957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:59.742758 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.743041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.743314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.745138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:59.749726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:59.750895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:59.754864 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:59.756885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3916729-138b-4d61-a880-63ca27012ce4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.765699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1325/2689] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:21:59.815885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1365/2690] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:21:59.824982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.825254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.825577 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.845054 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:59.847147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:59.856012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1326/2691] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:59.860112 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.870795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964862-12b0-47fe-8d74-a8a134ff7ece None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:59.875756 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:59.876421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.876707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.876988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.877792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:21:59.878108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:59.879731 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.893425 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1366/2692] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:21:59.897993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.907674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9080-fd42-4d2d-8782-a83a304a3caf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:59.912512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:59.913268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:59.913612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:59.913898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:59.914628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:59.916557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:59.947632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1327/2693] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:21:59 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:21:59.948221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:59.960655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857e1f7-a1c0-4ffb-b471-f65c0f21d345 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.029363 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.030201 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.030467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.030741 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.031437 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.033369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.054795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1367/2694] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:21:59 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:00.058448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.069581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4d8df-f72e-4518-bc38-a5aae8799497 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.074450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.075200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.075579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.075928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.076736 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.078384 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.090414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1328/2695] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:00.094200 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.106426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bff8a-59a9-43de-b098-a67caa5d61e6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.111237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.112040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.112328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.112604 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.113332 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.115126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eefd75-6fa8-4838-b8a2-22f23c7138b6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.129072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1368/2696] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:00.130314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.141308 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b98e-d18b-4e9e-ab6d-fd49da0e9f65 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.147785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.148686 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.149066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.149411 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] PATH_INFO: `/v3/projects/61615f832deb40baa2e7c7a4c3e68eaa/users/8737216cd9034ae4bb44589c7d2debc5/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.167114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61615f832deb40baa2e7c7a4c3e68eaa, user_id=8737216cd9034ae4bb44589c7d2debc5, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.169809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.186817 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1329/2697] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:00 2022] PUT /identity/v3/projects/61615f832deb40baa2e7c7a4c3e68eaa/users/8737216cd9034ae4bb44589c7d2debc5/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:00.198693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.199140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.199421 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.233253 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] MFA Rules not processed for user `8737216cd9034ae4bb44589c7d2debc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:00.234635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.276693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:00.308217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1369/2698] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:00.343290 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.345930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.409001 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718b64-fdc9-4e7f-a076-1cfc0676051f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.412822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.413518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.413801 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.414079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.423900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.425415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.437529 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1330/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:00.453779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.511964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.513937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.533159 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab240e8d-f460-4c9e-8821-d08801e56fe1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.539079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.540094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.540485 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.540890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] PATH_INFO: `/v3/users/8737216cd9034ae4bb44589c7d2debc5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.542345 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8737216cd9034ae4bb44589c7d2debc5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.544352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.548289 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:00.600461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8737216cd9034ae4bb44589c7d2debc5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.601686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8737216cd9034ae4bb44589c7d2debc5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.611090 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16114dc-6acb-449f-b78b-3aaf9e49ed76 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.614609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8737216cd9034ae4bb44589c7d2debc5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.616824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.617503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.617789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.618066 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.620087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.623380 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8737216cd9034ae4bb44589c7d2debc5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.633318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f9e2fb32-83a7-437e-b56d-cee82cd7f9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8737216cd9034ae4bb44589c7d2debc5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.634849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.636712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.640124 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1370/2700] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:00 2022] DELETE /identity/v3/users/8737216cd9034ae4bb44589c7d2debc5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:00.644770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.645063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.645350 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.650719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1331/2701] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:00.669089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:00.670360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.723410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:00.735965 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1371/2702] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:00.747595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.749147 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.809006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae911-e65c-4bc0-b4fa-d9957b4d9895 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.858549 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.859204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.859486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.859760 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.869881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.871378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636ae1-c2bc-4010-b5ae-7e583c8173ff service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.881831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1332/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:01.168848 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.170388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.184704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff5ef-1235-40d0-ac30-3c74503948a5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.189643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.190508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.190792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.191070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] PATH_INFO: `/v3/projects/61615f832deb40baa2e7c7a4c3e68eaa` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.192299 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61615f832deb40baa2e7c7a4c3e68eaa)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.194912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.245298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61615f832deb40baa2e7c7a4c3e68eaa', 'request_id': 'req-b76fc43e-db77-4158-ac33-58d19feecec2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:01.251514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61615f832deb40baa2e7c7a4c3e68eaa', 'request_id': 'req-b76fc43e-db77-4158-ac33-58d19feecec2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:01.258772 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61615f832deb40baa2e7c7a4c3e68eaa', 'request_id': 'req-b76fc43e-db77-4158-ac33-58d19feecec2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:01.271555 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] The token cache is being invalidate because project 61615f832deb40baa2e7c7a4c3e68eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:01.271892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:01.272836 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b76fc43e-db77-4158-ac33-58d19feecec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:01.274480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1372/2704] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:01 2022] DELETE /identity/v3/projects/61615f832deb40baa2e7c7a4c3e68eaa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:01.279398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.279682 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.279960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.299233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:01.300566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.366105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1333/2705] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:01.375023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.375367 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.375580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.395316 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:01.396525 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.405481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1373/2706] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:01.409655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.419754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59961-2ad1-4c17-bf81-a336e116b2f1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.424368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.425015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.425296 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.425615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.426339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:01.426647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.428361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.429934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:01.440850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1334/2707] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:01.445686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.455296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66454ad4-ce0c-40cf-908c-4c9445ee6b59 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.460720 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.461370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.461681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.461963 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.462671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.464591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.490042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1374/2708] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:01.494494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.504454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819d4e-632b-49e6-9c66-2d72f0dab064 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.563702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.564371 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.564655 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.564937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.565671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.567582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.591818 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1335/2709] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:01.596041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.608142 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60716689-3a0c-40b9-949c-816e67a623cc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.612747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.613424 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.613707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.613984 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.614698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.616296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.626975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1375/2710] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:01.630945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.641467 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5366a-b950-47d8-9fc2-8cc0458ae259 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.646355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.647615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.647894 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.648168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.648893 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.650516 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38714ebf-d178-43ce-bb9f-66ac4bf0ce87 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.660514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1336/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:01.664953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.675207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bd91-5011-4405-978e-e25e4230bc44 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.680737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.681667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.681947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.682226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] PATH_INFO: `/v3/projects/0346509d863b4c7bb2534206aa76fcd3/users/571d90a992034d7ea37016cee355a716/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.697916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346509d863b4c7bb2534206aa76fcd3, user_id=571d90a992034d7ea37016cee355a716, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.700580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.713362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1376/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:01 2022] PUT /identity/v3/projects/0346509d863b4c7bb2534206aa76fcd3/users/571d90a992034d7ea37016cee355a716/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:01.718473 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90a15-78df-41ad-957c-5e4a7a61a15e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.718763 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90a15-78df-41ad-957c-5e4a7a61a15e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.719041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90a15-78df-41ad-957c-5e4a7a61a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.737503 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1ef90a15-78df-41ad-957c-5e4a7a61a15e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:01.738703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ef90a15-78df-41ad-957c-5e4a7a61a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.799481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1337/2713] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:01.809593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.811281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.869009 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b50579-b5a3-43cb-a6e3-b3c888bad241 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.872543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.873177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.873486 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.873762 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.883593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.885022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.894732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1377/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:06.089207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.089753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.089858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.118885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] MFA Rules not processed for user `571d90a992034d7ea37016cee355a716`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:06.120134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:06.195508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1338/2715] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:06.199851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.210697 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef333f-1d2a-4a28-86a7-24848bc1db4f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.216046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.216717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.216996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.217266 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.218006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.220231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.242640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:06.259310 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.261511 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1378/2716] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:06 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:06.265522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:06.273998 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4fc4-cddb-4ced-ac71-54a5afac4fdd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.357800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.357800 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.358075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.358253 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.358977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.361248 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.386234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1339/2717] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:06 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:06.390337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.401798 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fdee-b59a-48fe-b4f1-25b779a6ec17 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.407394 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.408217 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.408633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.408983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.410000 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.411903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.425620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1379/2718] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:06.429646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.440724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33368af2-3de8-4db6-8b56-b761099ae065 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.446149 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.447135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.447448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.447728 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] PATH_INFO: `/v3/projects/e70f82b2856342b385725cba30918af0/users/7dec82e04a894c50850452a7f6f2d7e8/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.466944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70f82b2856342b385725cba30918af0, user_id=7dec82e04a894c50850452a7f6f2d7e8, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.469873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.493574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1340/2719] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:06 2022] PUT /identity/v3/projects/e70f82b2856342b385725cba30918af0/users/7dec82e04a894c50850452a7f6f2d7e8/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:06.494883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.505107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982896-cf8b-46b3-9dc3-9d022face889 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.584842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.584842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.584842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.584842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.586017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.586017 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d58d0-8094-4082-a0cc-b37dae2d2d06 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.598054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1380/2720] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:06.604702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:06.616559 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06a389-23a6-4d90-b5f4-da80ce7c4938 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:06.624607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:06.624820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:06.625512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:06.625980 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] PATH_INFO: `/v3/projects/e70f82b2856342b385725cba30918af0/users/7dec82e04a894c50850452a7f6f2d7e8/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:06.628221 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70f82b2856342b385725cba30918af0, user_id=7dec82e04a894c50850452a7f6f2d7e8, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:06.631550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:06.642769 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1341/2721] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:06 2022] PUT /identity/v3/projects/e70f82b2856342b385725cba30918af0/users/7dec82e04a894c50850452a7f6f2d7e8/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:11.543419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538f2e-a137-4700-8f27-a79296bae6d3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:11.549786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538f2e-a137-4700-8f27-a79296bae6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:11.550331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538f2e-a137-4700-8f27-a79296bae6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:11.585188 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dc538f2e-a137-4700-8f27-a79296bae6d3 None None] MFA Rules not processed for user `7dec82e04a894c50850452a7f6f2d7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:11.586639 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dc538f2e-a137-4700-8f27-a79296bae6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:11.705227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1381/2722] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:11.720742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:11.723240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:11.829006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cc04-09eb-4c2a-9bb0-bfc8c090dc6a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:11.834848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:11.835505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:11.835782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:11.836055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:11.900146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:11.918925 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:11.921071 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cc26e-7d80-4f98-a0e6-2fe1331613cc service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:11.932025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1342/2723] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:13.165037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:13.165642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:13.165642 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:13.185711 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] MFA Rules not processed for user `571d90a992034d7ea37016cee355a716`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:13.186953 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:13.195090 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1382/2724] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:21.927191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:23.178860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=72 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:43.553857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:43.554500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:43.554500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:43.573078 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] MFA Rules not processed for user `5fc0e8fe250349d699ea43aeee98170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:43.574357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:43.650010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1343/2725] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:22:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:43.966333 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:44.026020 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0a9a-db37-43ff-bc57-eb6b06ccb8bd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:44.029658 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:44.030312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:44.030595 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:44.030876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:44.032704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:44.043532 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:44.044975 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:44.054226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1383/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:44.393163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:44.394813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:44.471538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11576b-a7b2-4236-ac78-e9aa48f6ae85 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:44.477180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:44.477880 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:44.478193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:44.478475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:44.480343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:44.492225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:44.493789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:44.504833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1344/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:52.859436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:52.884666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166ca80-4192-411a-8d53-343876dc4856 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:52.898105 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:52.899428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.900359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.901046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.907156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:52.933964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:52.936982 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:52.955349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1384/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:54.500426 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=57 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:02.947327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=32 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:14.981250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.019838 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526645-10b2-44df-8941-ff2f5ec8bc7c service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.023523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.024163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.024447 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.024757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.053057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.054525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.064486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1345/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:25.060886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=27 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:28.855695 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:28.857724 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:28.923493 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a211ee-6fad-4727-ba5d-f57fa54aa04b service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:28.929358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:28.930033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:28.930319 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:28.930599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:28.932392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:28.943354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:28.944939 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:28.954239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1385/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:38.950067 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=28 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:25.973967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:25.996349 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b430ae2-a829-4777-a113-1cc3a7e8c9b0 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:26.001435 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:26.002065 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:26.002345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:26.002619 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:26.004345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:26.028032 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:26.029628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:26.039939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1346/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:25:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:25:36.035861 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:41.157304 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:41.185821 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1692d-ba7e-415c-ba37-284795b94475 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:41.191785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:41.192416 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:41.192692 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:41.192968 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:41.194780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:41.273275 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:41.274913 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:41.293116 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1386/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:25:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:25:51.290468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=48 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:33.048792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:33.058523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5dca6-f716-4202-b54d-ef78247a4de5 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:33.062091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:33.062718 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:33.062997 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:33.063272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:33.065003 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:33.090849 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:33.092264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:33.102960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1347/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:36.395823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:36.405133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ab73a-aae1-4a77-b0c6-887fc87e323f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:36.408729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:36.409362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:36.409678 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:36.409960 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:36.412236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:36.425778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:36.427853 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:36.438884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1387/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:43.098697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=11 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:46.433976 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:54.964127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:54.965587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:55.041712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11eb7-cdfc-458a-a56e-b4ab0924c7ac service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:55.045348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:55.046016 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:55.046403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:55.046687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:55.048452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:55.110176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:55.111915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:55.121671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1348/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:05.117539 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=57 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:12.015682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:12.027917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3c28-10da-4130-9085-057d3b8160da service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:12.034173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:12.035456 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:12.035740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:12.036008 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:12.044517 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:12.046132 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:12.054841 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1388/2736] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:27:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:21.692181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:21.701432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b005a29-8a3d-4c43-8a8f-a57ca126f57a service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:21.705006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:21.705704 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:21.706565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:21.706847 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:21.708671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:21.733733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:21.735432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:21.743748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1349/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:27:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:22.050906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:31.740067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=11 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:08.511742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:08.513158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:08.526375 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c7f4f-3e63-4a49-bfda-301a7d14e4ab service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:08.530031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:08.530666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:08.530949 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:08.532076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:08.540682 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:08.542210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:08.568856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1389/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:18.566221 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=13 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:31.948080 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:31.949536 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:31.964699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f61695-0bbc-469a-93aa-21acf28a9c42 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:31.970398 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:31.971045 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:31.971333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:31.971613 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:31.980462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:31.982074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:31.992409 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1350/2739] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:41.988167 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:56.553404 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:56.563439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787d2e-3293-4b55-a54d-8ee5ee2b6ce0 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:56.567170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:56.567800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:56.568080 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:56.568354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:56.576734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:56.578844 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:56.587768 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1390/2740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:58.995576 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:59.008657 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddac74-3a74-4763-a0b2-10260b4b6457 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:59.014442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:59.015097 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:59.016587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:59.016879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:59.019075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:59.034084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:59.035609 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:59.048883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1351/2741] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:06.583583 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:09.043015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:08.753257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:08.762237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403da8-22ac-4630-8b00-7c9de3370f04 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:08.766989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:08.767608 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:08.767886 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:08.768155 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:08.778323 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:08.779851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:08.790489 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1391/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:32:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:32:08.797327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:08.806450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fdd2-4aa1-45f9-9f26-9a13d8e98d21 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:08.810494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:08.811117 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:08.811395 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:08.811669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:08.819978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:08.821392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:08.848586 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1352/2743] 10.222.0.16 () {60 vars in 1396 bytes} [Mon Jun 20 06:32:08 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:32:08.977393 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:08.987154 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7bcbe-9d7b-46f4-b14b-5d9fc38f737b service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:08.990830 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:08.991463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:08.991742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:08.992015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:09.003581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:09.005006 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:09.016887 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1392/2744] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:32:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:32:18.845869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=13 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:19.011387 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=12 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:24.711405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:24.713000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:32:24.725372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f8b3-a77d-4fdc-ad81-3d077aa18667 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:24.728957 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:24.729627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:24.729936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:24.730214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:24.737478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:24.738884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:24.746756 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1353/2745] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:32:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:32:34.743206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:56.790631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:56.865033 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228efab-1779-4d30-ab65-94cef88dc395 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:56.871070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:56.871709 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:56.871989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:56.872262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:56.874182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:32:56.913255 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:32:56.923833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a9d9-1353-4f16-89e5-1ec947904aef service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:32:56.927982 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:32:56.928610 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:32:56.928887 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:32:56.929354 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:32:56.931439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:32:56.957178 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:56.958840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:56.977990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1393/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:32:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:32:56.991291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:32:56.992755 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:32:57.001679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1354/2747] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:32:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:33:06.975179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=69 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:33:06.997441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=28 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:37.917778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:35:37.919356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:35:38.063328 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a01c57-e650-42c7-aedc-b021811040ae service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:35:38.069199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:35:38.069869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:35:38.070152 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:35:38.070427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:35:38.072330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:35:38.084027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:35:38.085653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:35:38.096368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1394/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:35:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:35:48.091565 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=63 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:10.071522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:36:10.091229 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b096c5-c337-47bf-b2bc-86178e575830 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:36:10.095005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:36:10.095652 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:36:10.095939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:36:10.096217 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:36:10.098234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:36:10.170562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:36:10.172000 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:36:10.181487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1355/2749] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:36:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:36:10.224001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:36:10.234273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca3635-8a45-4b7f-9a4c-34213f21a5f5 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:36:10.237901 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:36:10.238567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:36:10.238878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:36:10.239170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:36:10.241044 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:36:10.322883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:36:10.324250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:36:10.343031 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1395/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:36:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:36:20.176716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=38 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:20.340348 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=41 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:58.091338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:36:58.093027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:36:58.147745 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c23b3-e8da-47c1-ad0d-a33dbccdee3c service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:36:58.153526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:36:58.154184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:36:58.154466 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:36:58.154748 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:36:58.165719 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:36:58.167338 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:36:58.180387 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1356/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:36:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:37:08.174835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=18 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:09.811962 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:37:09.873568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0d09-09db-4016-9415-4fa9462bd688 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:37:09.877140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:37:09.877804 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:37:09.878082 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:37:09.878359 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:37:09.880206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:37:09.893641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:37:09.895065 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:37:09.906752 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1396/2752] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:37:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:37:11.013049 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:37:11.023337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb1ac4-ddb2-4e19-9b42-7fe2bfdb1457 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:37:11.026978 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:37:11.027614 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:37:11.027898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:37:11.028174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:37:11.030085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:37:11.043732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:37:11.045158 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:37:11.057627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1357/2753] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:37:19.901847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=30 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:21.051422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:28.670621 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:37:28.679937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8996-77e9-45d3-8eb8-4646e2a3b73b service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:37:28.684399 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:37:28.685042 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:37:28.685322 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:37:28.685664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:37:28.687571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:37:28.716001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:37:28.718023 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:37:28.726716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1397/2754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:37:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:37:38.722674 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=11 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:57.335669 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:37:57.348154 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af58cc-0f44-49bf-8ea3-7c5c3e6392eb service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:37:57.353702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:37:57.354329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:37:57.354606 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:37:57.354876 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:37:57.363324 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:37:57.364889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:37:57.374442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1358/2755] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:37:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:38:07.369678 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:10.616148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:38:10.678971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b60e-7ebf-4f78-8464-fd20c13964bc service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:38:10.682579 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:38:10.683207 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:38:10.683491 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:38:10.683766 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:38:10.685727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:38:10.756392 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:38:10.757877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:38:10.767452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1398/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:38:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:38:20.762707 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=57 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:59.223828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:38:59.233660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a017-9412-4a4f-a145-13ac134625f8 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:38:59.237482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:38:59.238129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:38:59.238414 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:38:59.238691 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:38:59.240588 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:38:59.328867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:38:59.328867 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:38:59.345940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1359/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:39:02.345362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:02.357776 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff5d8-e3b0-470f-8d47-818c535d1bc8 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:02.362726 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:02.363368 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:02.363654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:02.363929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:02.366402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:39:02.378683 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:02.380269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:02.391594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1399/2758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:39:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:39:05.463316 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:05.475064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10508-d8d2-4f22-8136-fcac30c6c508 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:05.485464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:05.486482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:05.487797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:05.488238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:05.491168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:39:05.514193 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:05.516494 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:05.532145 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:05.534063 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:39:05.537500 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1360/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:39:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:39:05.548701 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4627096-495c-47c9-8f6b-7b4ce6ac37ad service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:05.553600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:05.554462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:05.554742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:05.555018 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] PATH_INFO: `/v3/users/571d90a992034d7ea37016cee355a716` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:05.556487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=571d90a992034d7ea37016cee355a716)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:05.558529 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:05.605820 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571d90a992034d7ea37016cee355a716'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.606451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571d90a992034d7ea37016cee355a716'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.618167 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571d90a992034d7ea37016cee355a716'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.624920 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571d90a992034d7ea37016cee355a716'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.632210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571d90a992034d7ea37016cee355a716'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.639383 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1400/2760] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:39:05 2022] DELETE /identity/v3/users/571d90a992034d7ea37016cee355a716 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:39:05.809492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:05.825550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7b540-08aa-422b-8c65-d4113bc971df service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:05.883512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:05.884465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:05.884754 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:05.885026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] PATH_INFO: `/v3/projects/0346509d863b4c7bb2534206aa76fcd3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:05.886239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0346509d863b4c7bb2534206aa76fcd3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:05.888235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:05.934629 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0346509d863b4c7bb2534206aa76fcd3', 'request_id': 'req-d080d536-3a38-4577-b1bd-9edc4e1cad3c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.938165 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:39:05.941994 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0346509d863b4c7bb2534206aa76fcd3', 'request_id': 'req-d080d536-3a38-4577-b1bd-9edc4e1cad3c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.948656 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0346509d863b4c7bb2534206aa76fcd3', 'request_id': 'req-d080d536-3a38-4577-b1bd-9edc4e1cad3c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.959724 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] The token cache is being invalidate because project 0346509d863b4c7bb2534206aa76fcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:39:05.960011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.960628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:05.962946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1361/2761] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:39:05 2022] DELETE /identity/v3/projects/0346509d863b4c7bb2534206aa76fcd3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:39:05.966862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:05.968264 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:39:05.981792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e3c24-0103-4e5d-b06e-f8ee73c785ea admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:06.037183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:06.038077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:06.038357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:06.038626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] PATH_INFO: `/v3/users/7dec82e04a894c50850452a7f6f2d7e8` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:06.052057 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dec82e04a894c50850452a7f6f2d7e8)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:06.053966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:06.098121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dec82e04a894c50850452a7f6f2d7e8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.098761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dec82e04a894c50850452a7f6f2d7e8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.100765 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:39:06.114055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dec82e04a894c50850452a7f6f2d7e8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.120919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dec82e04a894c50850452a7f6f2d7e8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.128932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dec82e04a894c50850452a7f6f2d7e8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.135370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1401/2762] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:39:05 2022] DELETE /identity/v3/users/7dec82e04a894c50850452a7f6f2d7e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:39:06.305438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:39:06.306915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:39:06.319990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d536-3a38-4577-b1bd-9edc4e1cad3c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:39:06.388013 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:39:06.389128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:39:06.389424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:39:06.389698 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] PATH_INFO: `/v3/projects/e70f82b2856342b385725cba30918af0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:39:06.400582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70f82b2856342b385725cba30918af0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:39:06.400582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:39:06.446638 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70f82b2856342b385725cba30918af0', 'request_id': 'req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.461403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70f82b2856342b385725cba30918af0', 'request_id': 'req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.467119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70f82b2856342b385725cba30918af0', 'request_id': 'req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.478976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] The token cache is being invalidate because project e70f82b2856342b385725cba30918af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:39:06.479260 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.479885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:39:06.481487 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1362/2763] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:39:06 2022] DELETE /identity/v3/projects/e70f82b2856342b385725cba30918af0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:39:16.131783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:39:16.475433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=61,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:42.931234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:40:42.932688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:40:43.003030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc760ed-f797-42e4-ae5e-a8478de0b794 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:40:43.064610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:40:43.065184 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:40:43.065499 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:40:43.065792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:40:43.068068 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:40:43.080902 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:40:43.083737 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:40:43.093837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1402/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:40:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:40:53.089514 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=58 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:10.509514 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:10.511287 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:10.569831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cd988-f876-4f3b-9b1c-2fa7f0b78516 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:10.573797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:10.574446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:10.574732 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:10.575014 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:10.576802 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:10.646666 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:10.648112 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:10.659906 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1363/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:42:11.178226 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:11.179712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:11.248940 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2fc7-877b-4c3b-8251-1a4be3887c6f service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:11.252553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:11.253194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:11.253506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:11.253789 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:11.255570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:11.323104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:11.324591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:11.343472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1403/2766] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:42:11.386812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:11.396263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a9f5-0acc-4940-9fa8-f04245f64df8 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:11.399850 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:11.400483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:11.400765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:11.401042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:11.402945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:11.462796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:11.464176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:11.473030 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1364/2767] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:42:11.830027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:11.839684 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67380-fbb2-45ab-b1f0-425fca370b2f service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:11.843259 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:11.843889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:11.844173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:11.844451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:11.846233 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:11.860401 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:11.861882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:11.873866 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1404/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:42:21.468933 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=82 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:21.867969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=67 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:33.645200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:33.654504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949d85-ac9b-4bc1-a71b-ff125d9424f3 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:33.658043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:33.658673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:33.658950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:33.659224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:33.660977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:33.671121 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:33.672527 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:33.680583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1365/2769] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:42:43.676775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:58.474089 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:58.475513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:58.487475 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7369c-f37b-41ee-9772-ae44da4c7d7e service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:58.491194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:58.491840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:58.492126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:58.492408 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:58.496905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] Could not find project: 0346509d863b4c7bb2534206aa76fcd3.: keystone.exception.ProjectNotFound: Could not find project: 0346509d863b4c7bb2534206aa76fcd3. Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 20 06:42:58.511446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:42:58.512619 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:42:58.516047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:42:58.517282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:42:58.518527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0346509d863b4c7bb2534206aa76fcd3. Jun 20 06:42:58.518527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: ERROR keystone.server.flask.application Jun 20 06:42:58.518527 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1405/2770] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:58 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 20 06:42:59.584743 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:42:59.586451 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:59.603570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9995-2318-4be5-9fb7-f08ba7534745 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:42:59.610510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:42:59.611163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:42:59.611445 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:42:59.611725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:42:59.613592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:42:59.629272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:42:59.630898 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:42:59.643437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1366/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:43:01.288194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:43:01.290047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:43:01.309729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53667a6-331c-4298-b598-778529ba664e service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:43:01.319764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:43:01.320941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:43:01.321538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:43:01.321981 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:43:01.324568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:43:01.341734 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:43:01.343506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:43:01.357358 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1406/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:43:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:43:09.638986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:10.560226 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:43:10.571562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84093bed-73dd-4051-8bfe-55fb2a31f1e6 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:43:10.577855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:43:10.578493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:43:10.578777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:43:10.579057 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:43:10.580885 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:43:10.647596 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:43:10.649174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:43:10.666789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1367/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:43:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:43:11.351280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:20.664218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=36 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:01.500461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:01.510093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e743a-167c-45e1-b2c1-eccece6df6bf service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:01.514315 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:01.514950 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:01.515257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:01.515535 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:01.517289 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:01.579718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:01.581219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:01.592898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1407/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:45:04.757235 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:04.759620 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:04.782275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec048-eb5a-4dad-95b0-edb4c8a97a55 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:04.787835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:04.788687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:04.789037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:04.789401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:04.791468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:04.803777 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:04.805512 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:04.826306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1368/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:45:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:45:04.869506 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:04.872481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:04.885757 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247a590-8054-4a9b-8c6f-2730182d7df9 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:04.891693 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:04.892563 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:04.892843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:04.893117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] PATH_INFO: `/v3/users/5fc0e8fe250349d699ea43aeee98170e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:04.894326 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc0e8fe250349d699ea43aeee98170e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:04.896248 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:04.944140 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc0e8fe250349d699ea43aeee98170e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:04.944783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc0e8fe250349d699ea43aeee98170e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:04.957546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc0e8fe250349d699ea43aeee98170e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:04.964969 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc0e8fe250349d699ea43aeee98170e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:04.972327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efdbddd5-5f89-4393-be57-373367e1e3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc0e8fe250349d699ea43aeee98170e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:04.978117 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1408/2776] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:45:04 2022] DELETE /identity/v3/users/5fc0e8fe250349d699ea43aeee98170e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:45:05.158214 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.173095 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804721-06e5-45e1-b1bf-3b0f69ef907b service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.230574 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.231443 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.231723 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.231995 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] PATH_INFO: `/v3/projects/8a2203406ec34776ab1a1e663601baaf` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.233191 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2203406ec34776ab1a1e663601baaf)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.235108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.286773 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2203406ec34776ab1a1e663601baaf', 'request_id': 'req-30930b19-bc74-4121-8298-a2283651c143'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:05.294538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2203406ec34776ab1a1e663601baaf', 'request_id': 'req-30930b19-bc74-4121-8298-a2283651c143'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:05.300404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2203406ec34776ab1a1e663601baaf', 'request_id': 'req-30930b19-bc74-4121-8298-a2283651c143'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:05.313520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] The token cache is being invalidate because project 8a2203406ec34776ab1a1e663601baaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:45:05.313520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:05.314044 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-30930b19-bc74-4121-8298-a2283651c143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:45:05.315889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1369/2777] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:45:05 2022] DELETE /identity/v3/projects/8a2203406ec34776ab1a1e663601baaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:45:05.322223 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.322783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.323104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.382781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:45:05.384038 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:05.415885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:05.445786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1409/2778] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:45:05.454124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.454415 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.454703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.473351 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:45:05.474583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:05.482658 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1370/2779] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:45:05.486644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.496273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1355b1-a419-4cf7-9192-f868a9584a6b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.500895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.501572 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.501856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.502133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.502852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:45:05.503158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.504754 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.516833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1410/2780] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:45:05.520987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.530740 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f18711-b99e-46c2-bf3a-eaf8c73c30fe None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.535386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.536027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.536313 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.536592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.537275 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.539234 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.576792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1371/2781] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:45:05.581419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.595246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207db88-9cfe-4d7b-9b92-3dcbd3e14a22 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.653487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.654079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.654365 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.654643 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.655349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.657278 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.676648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1411/2782] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:45:05.680902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.691945 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017b3d-0491-484b-8456-79920e7821f0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.697418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.698074 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.699120 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.699424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.700114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.701742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.711733 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1372/2783] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:45:05.716568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.726685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093951f8-36b5-4061-a8b0-526770f5c64b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.731467 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.732107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.732390 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.732663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.733419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.735001 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4601-5000-4504-a491-a579df72be67 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.744729 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1412/2784] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:45:05.749490 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.759242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde253-e63e-42e8-8e53-78ba7c0001dd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.764714 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.765630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.765909 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.766183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] PATH_INFO: `/v3/projects/323812616c8b42228d24c2a4fbd80f5f/users/91ab47cec6cd455ea1e3c3db93788d9e/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.780846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=323812616c8b42228d24c2a4fbd80f5f, user_id=91ab47cec6cd455ea1e3c3db93788d9e, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.783550 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:05.796187 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1373/2785] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:45:05 2022] PUT /identity/v3/projects/323812616c8b42228d24c2a4fbd80f5f/users/91ab47cec6cd455ea1e3c3db93788d9e/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:45:05.806325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.806620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.806905 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.836481 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] MFA Rules not processed for user `91ab47cec6cd455ea1e3c3db93788d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:45:05.837791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:05.903024 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1413/2786] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:45:05.909262 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:05.914750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:05.974462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5fc4-8b8b-4deb-8eee-2f6b55a8f0dd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:05.979163 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:05.980462 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:05.980591 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:05.980863 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:05.981589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:05.983530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.008405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1374/2787] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:45:06.012954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:06.023677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a8115-de7d-4a39-95ab-c047408ee44c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:06.054361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:06.083513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:06.084183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.084468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.084748 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.085461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:06.087420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.106937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1414/2788] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:45:06 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:45:06.111011 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:06.122339 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b97df-fa26-4e11-9968-8abd83d77a89 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:06.127010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:06.127664 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.127953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.128219 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.128939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:06.130575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.141555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1375/2789] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:45:06.145685 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:06.155648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebafeb-74f0-449c-b62a-81fc33f65518 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:06.160238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:06.161046 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.161327 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.161638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] PATH_INFO: `/v3/projects/7e0e5c089f4d4a85be65d5811490dd18/users/2cf7e29db5c84dcfb45cf851ebec8b02/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.176461 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0e5c089f4d4a85be65d5811490dd18, user_id=2cf7e29db5c84dcfb45cf851ebec8b02, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:06.179135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.193640 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1415/2790] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:45:06 2022] PUT /identity/v3/projects/7e0e5c089f4d4a85be65d5811490dd18/users/2cf7e29db5c84dcfb45cf851ebec8b02/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:45:06.197506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:06.207481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b671-b66b-475b-a94b-d3865f245a79 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:06.262940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:06.263618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.263896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.264168 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.264883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:06.266556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712143a-bf91-48b8-b55f-f5365ea36d1d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.276058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1376/2791] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:45:06.280204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:06.290497 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419cb91-ee50-4f15-b977-e70987349683 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:06.295654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:06.296550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.296847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.297109 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] PATH_INFO: `/v3/projects/7e0e5c089f4d4a85be65d5811490dd18/users/2cf7e29db5c84dcfb45cf851ebec8b02/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.299106 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0e5c089f4d4a85be65d5811490dd18, user_id=2cf7e29db5c84dcfb45cf851ebec8b02, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:06.301778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:06.313478 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1416/2792] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:45:06 2022] PUT /identity/v3/projects/7e0e5c089f4d4a85be65d5811490dd18/users/2cf7e29db5c84dcfb45cf851ebec8b02/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:45:06.325114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:06.325458 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:06.325753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:06.353091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] MFA Rules not processed for user `2cf7e29db5c84dcfb45cf851ebec8b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:45:06.354492 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:06.424004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:06.431785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1377/2793] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:45:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:45:16.308871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=30,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:47.926778 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:45:47.928574 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:48.057644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1709-613e-4edc-a51a-edc952480ef2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:45:48.062782 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:45:48.063431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:45:48.063710 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:45:48.063983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:45:48.065809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:45:48.078281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:45:48.079900 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:45:48.089932 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1417/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:45:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:45:58.085816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=58 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:13.425428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:46:13.426820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:46:13.502460 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620db09-65d3-40d2-acfd-efa2aea74303 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:46:13.506152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:46:13.506786 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:46:13.507064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:46:13.507335 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:46:13.517061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:46:13.518504 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec870ae-5b78-45ce-ab8d-fb9914d6ae4b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:46:13.528292 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1378/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:46:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:46:23.523542 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=35 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:01.461750 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:01.533558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3418-91ac-41e0-a4cb-9c5623ceffe3 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:01.539015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:01.539919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:01.540199 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:01.540476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] PATH_INFO: `/v3/users/91ab47cec6cd455ea1e3c3db93788d9e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:01.542283 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ab47cec6cd455ea1e3c3db93788d9e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:01.544220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:01.590983 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ab47cec6cd455ea1e3c3db93788d9e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:01.591570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ab47cec6cd455ea1e3c3db93788d9e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:01.603469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ab47cec6cd455ea1e3c3db93788d9e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:01.610150 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ab47cec6cd455ea1e3c3db93788d9e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:01.617194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ab47cec6cd455ea1e3c3db93788d9e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:01.623062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1418/2796] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:47:01 2022] DELETE /identity/v3/users/91ab47cec6cd455ea1e3c3db93788d9e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:01.627632 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:01.628184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:01.628184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:01.646069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:47:01.647266 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:01.704984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1379/2797] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:47:01.715054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:01.716444 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:01.776340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdeb7c-7d60-486d-8f89-c69fb53963eb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:01.780219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:01.780861 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:01.781148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:01.781457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:01.790494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:01.792069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:01.801433 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1419/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:47:02.069506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.071010 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:02.084115 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4797-a633-41cd-b022-c4046f4e6568 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.088699 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:02.089579 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.089858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.090128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] PATH_INFO: `/v3/projects/323812616c8b42228d24c2a4fbd80f5f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.091434 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323812616c8b42228d24c2a4fbd80f5f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:02.093327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:02.142378 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323812616c8b42228d24c2a4fbd80f5f', 'request_id': 'req-02eb8696-70c0-4904-b9b5-09e6a6f926a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.150125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323812616c8b42228d24c2a4fbd80f5f', 'request_id': 'req-02eb8696-70c0-4904-b9b5-09e6a6f926a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.155771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323812616c8b42228d24c2a4fbd80f5f', 'request_id': 'req-02eb8696-70c0-4904-b9b5-09e6a6f926a5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.167171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] The token cache is being invalidate because project 323812616c8b42228d24c2a4fbd80f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:47:02.167452 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.168076 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.169646 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1380/2799] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:47:02 2022] DELETE /identity/v3/projects/323812616c8b42228d24c2a4fbd80f5f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:02.173671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.184671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7072-24d1-46ad-be10-e3c0aae8da1d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.196600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:02.242670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:02.243539 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.243824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.244103 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] PATH_INFO: `/v3/users/2cf7e29db5c84dcfb45cf851ebec8b02` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.245993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf7e29db5c84dcfb45cf851ebec8b02)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:02.247923 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:02.292937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf7e29db5c84dcfb45cf851ebec8b02'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.293620 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf7e29db5c84dcfb45cf851ebec8b02'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.305521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf7e29db5c84dcfb45cf851ebec8b02'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.313072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf7e29db5c84dcfb45cf851ebec8b02'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.320549 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-db258ef3-d4dc-4df8-b260-fa5eaae31493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf7e29db5c84dcfb45cf851ebec8b02'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.326925 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1420/2800] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:47:02 2022] DELETE /identity/v3/users/2cf7e29db5c84dcfb45cf851ebec8b02 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:02.591937 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.593329 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:02.608185 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb8696-70c0-4904-b9b5-09e6a6f926a5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.680520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:02.681295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.681608 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.681944 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] PATH_INFO: `/v3/projects/7e0e5c089f4d4a85be65d5811490dd18` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.683228 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0e5c089f4d4a85be65d5811490dd18)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:02.685126 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:02.714753 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:02.732333 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0e5c089f4d4a85be65d5811490dd18', 'request_id': 'req-6207a830-7229-4748-9fb5-b82de4add35b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.739555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0e5c089f4d4a85be65d5811490dd18', 'request_id': 'req-6207a830-7229-4748-9fb5-b82de4add35b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.745084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0e5c089f4d4a85be65d5811490dd18', 'request_id': 'req-6207a830-7229-4748-9fb5-b82de4add35b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.755940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] The token cache is being invalidate because project 7e0e5c089f4d4a85be65d5811490dd18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:47:02.756225 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.756846 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6207a830-7229-4748-9fb5-b82de4add35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:47:02.758427 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1381/2801] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:47:02 2022] DELETE /identity/v3/projects/7e0e5c089f4d4a85be65d5811490dd18 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:02.763727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.764191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.764325 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.782173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:47:02.783378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:02.841989 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1421/2802] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:47:02.849959 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.850251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.850558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.869259 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:47:02.870565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:02.878525 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1382/2803] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:47:02.882562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.892871 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a24a13-a5cd-4837-ab1c-289b5ca52341 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.897462 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:02.898102 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.898384 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.898661 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.899373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:47:02.899675 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:02.902121 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:02.913508 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1422/2804] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:47:02.917676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.926890 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92432a7c-6de0-4911-9fae-aa83ce66dd92 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.931648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:02.932331 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:02.932566 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:02.932843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:02.933594 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:02.935486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:02.960453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1383/2805] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:47:02 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:47:02.964654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:02.974474 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49d9a-e85f-4f8c-b6a0-df3221201efc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:02.995718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:03.032582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.033274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.033590 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.033874 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.034567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.036479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.055747 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1423/2806] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:47:02 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:47:03.060570 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.070799 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e2d7-5104-4ebb-bbbc-58afad92e72e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.075526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43657738-f859-4370-8d96-336b992f755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.076179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657738-f859-4370-8d96-336b992f755c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.076465 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657738-f859-4370-8d96-336b992f755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.076747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657738-f859-4370-8d96-336b992f755c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.077507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43657738-f859-4370-8d96-336b992f755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.079120 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43657738-f859-4370-8d96-336b992f755c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.089627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1384/2807] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:47:03.093669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.104173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daabecd-f779-4989-9629-ee65a17e00de admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.108869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.109557 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.109840 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.110133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.110833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.112428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703fc7f-cbb3-4a41-b9ee-a8d6740ab70d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.124556 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1424/2808] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:47:03.128926 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43657738-f859-4370-8d96-336b992f755c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.139263 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43657738-f859-4370-8d96-336b992f755c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.143923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.144788 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.145072 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.145350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] PATH_INFO: `/v3/projects/168f119c0c9b47429e3ed26a7eabda5b/users/b7d627cbfe32469a8f653857df231770/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.159835 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168f119c0c9b47429e3ed26a7eabda5b, user_id=b7d627cbfe32469a8f653857df231770, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.162511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.178420 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1385/2809] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:47:03 2022] PUT /identity/v3/projects/168f119c0c9b47429e3ed26a7eabda5b/users/b7d627cbfe32469a8f653857df231770/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:03.189443 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.189672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.189980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.215337 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] MFA Rules not processed for user `b7d627cbfe32469a8f653857df231770`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:47:03.216537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:03.282115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1425/2810] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:47:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:47:03.286702 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.348326 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca658-9044-4809-8606-fc3804eb3cd8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.352886 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.354171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.354677 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.354796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.355391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.357270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.381922 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1386/2811] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:47:03 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:47:03.385668 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.396593 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c87eb-339d-471f-ba2d-ab172798c802 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.452204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.452792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.453076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.453351 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.454123 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.456029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.475987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1426/2812] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:47:03 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:47:03.480673 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.491085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eaea-8c38-4c93-8240-d9dee19c1085 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.495695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.496348 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.496628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.496905 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.497660 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.499273 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.509775 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1387/2813] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:47:03.514094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.523955 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f2a7-2583-4ab1-ac85-9ccda707a660 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.529751 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.530648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.530935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.531210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] PATH_INFO: `/v3/projects/2a46f301823f4c06a6a1e9839c420a86/users/4ae079fc9ff1416f9adb37a39541d31b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.546712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a46f301823f4c06a6a1e9839c420a86, user_id=4ae079fc9ff1416f9adb37a39541d31b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.549371 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.557338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:03.563446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1427/2814] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:47:03 2022] PUT /identity/v3/projects/2a46f301823f4c06a6a1e9839c420a86/users/4ae079fc9ff1416f9adb37a39541d31b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:03.567300 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.577757 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ad16b-a1e2-4937-8fb9-c6e14f6be8ba admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.597705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:03.636984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.637683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.637967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.638246 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.638967 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.640565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9f38c-1030-4457-88a7-4222b3540fac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.651119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1388/2815] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:47:03.655271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:03.666224 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6f9d-8064-4c56-9160-f1eebb3801ad admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:03.671250 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:03.672193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.672466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.672742 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] PATH_INFO: `/v3/projects/2a46f301823f4c06a6a1e9839c420a86/users/4ae079fc9ff1416f9adb37a39541d31b/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.674837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a46f301823f4c06a6a1e9839c420a86, user_id=4ae079fc9ff1416f9adb37a39541d31b, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:03.677544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:03.688568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1428/2816] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:47:03 2022] PUT /identity/v3/projects/2a46f301823f4c06a6a1e9839c420a86/users/4ae079fc9ff1416f9adb37a39541d31b/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:47:03.700595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:03.701113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:03.701251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:03.730593 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] MFA Rules not processed for user `4ae079fc9ff1416f9adb37a39541d31b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:47:03.731717 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:03.799986 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1389/2817] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:47:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:47:10.297141 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:10.298884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:10.365541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658244e-8755-4430-a921-626899f930c2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:10.369660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:10.370270 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:10.370548 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:10.370823 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:10.372558 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:10.459721 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:10.461158 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:10.482329 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1429/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:47:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:47:11.540750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:11.542270 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:11.558530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352dad-166e-4080-aadc-9ff301a36b42 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:11.564213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982057be-0702-4329-854d-abb637667df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:11.564851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982057be-0702-4329-854d-abb637667df3 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:11.565131 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982057be-0702-4329-854d-abb637667df3 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:11.565432 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982057be-0702-4329-854d-abb637667df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:11.567184 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-982057be-0702-4329-854d-abb637667df3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:11.646814 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982057be-0702-4329-854d-abb637667df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:11.648404 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982057be-0702-4329-854d-abb637667df3 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:11.666730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1390/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:47:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:47:11.716236 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:47:11.724867 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203def-44a2-4d99-9f0a-f865fa63adda service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:47:11.728567 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:47:11.729364 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:47:11.729680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:47:11.729958 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:47:11.731732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:47:11.745411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:47:11.746876 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:47:11.757802 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1430/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:47:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:47:21.663976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:21.752833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:13.742028 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982057be-0702-4329-854d-abb637667df3 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:48:13.744133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-982057be-0702-4329-854d-abb637667df3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:48:13.809701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982057be-0702-4329-854d-abb637667df3 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:48:13.813343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:48:13.814005 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:48:13.814282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:48:13.814555 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:48:13.816282 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:48:13.891583 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:48:13.893145 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:48:13.904144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1391/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:48:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:48:13.931635 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:48:13.940931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3fb08-e2ef-475b-9eed-a23f55f2d2eb service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:48:13.944719 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:48:13.945349 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:48:13.945666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:48:13.946521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:48:13.955512 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:48:13.956943 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:48:13.966761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1431/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:48:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:48:23.899084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=57 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:23.962177 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:50:53.922581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:50:53.923983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:50:53.992665 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8e93-0688-40a2-8121-8489e332aad1 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:50:53.997896 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:50:53.998538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:50:53.998820 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:50:53.999103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:50:54.000848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:50:54.013636 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:50:54.015198 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:50:54.027063 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1392/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:50:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:51:04.022807 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=32 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:14.230850 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:14.240274 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a9ea-36f3-468e-aca2-031a4dc3b0b1 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:14.243916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:14.244543 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:14.244828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:14.245136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:14.303162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:14.304602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:14.313655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1432/2824] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:52:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:52:14.548075 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:14.557984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaabf-74aa-46ae-a913-f2499a3cc8e5 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:14.561954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:14.562689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:14.562973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:14.563250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:14.572582 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:14.574042 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782e39-2a12-4052-9d3d-132fbd4bce3f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:14.583812 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1393/2825] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:52:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:52:14.673603 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:14.765924 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fbf62-13ae-4270-9bf0-cb44ac710222 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:14.771427 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:14.772285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:14.772564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:14.772837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] PATH_INFO: `/v3/users/b7d627cbfe32469a8f653857df231770` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:14.774021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d627cbfe32469a8f653857df231770)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:14.775917 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:14.823356 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d627cbfe32469a8f653857df231770'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:14.823997 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d627cbfe32469a8f653857df231770'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:14.836219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d627cbfe32469a8f653857df231770'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:14.842879 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d627cbfe32469a8f653857df231770'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:14.849568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d627cbfe32469a8f653857df231770'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:14.851644 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:14.856385 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1433/2826] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:52:14 2022] DELETE /identity/v3/users/b7d627cbfe32469a8f653857df231770 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:52:14.860970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:14.861832 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:14.862100 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:14.892048 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:52:14.894355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:14.954424 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1394/2827] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:52:14.964570 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:14.966054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:15.033764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f2b0d-73db-4b67-ab72-94d2fb133a64 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:15.037287 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:15.038014 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:15.038295 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:15.038571 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:15.047440 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:15.049431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:15.058749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1434/2828] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:52:15.325628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:15.327355 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:15.341122 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f36225-a9e0-4161-b3d5-e1b6efd16fb4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:15.347124 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:15.347822 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:15.348128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:15.348405 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] PATH_INFO: `/v3/projects/168f119c0c9b47429e3ed26a7eabda5b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:15.350327 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] RBAC: Authorizing `identity:delete_project(project_id=168f119c0c9b47429e3ed26a7eabda5b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:15.352436 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:15.400342 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168f119c0c9b47429e3ed26a7eabda5b', 'request_id': 'req-fdbe309d-3756-4517-a3ba-0b9667df428f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.407178 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168f119c0c9b47429e3ed26a7eabda5b', 'request_id': 'req-fdbe309d-3756-4517-a3ba-0b9667df428f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.413107 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168f119c0c9b47429e3ed26a7eabda5b', 'request_id': 'req-fdbe309d-3756-4517-a3ba-0b9667df428f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.424152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] The token cache is being invalidate because project 168f119c0c9b47429e3ed26a7eabda5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:52:15.424437 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.425067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.426651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1395/2829] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:52:15 2022] DELETE /identity/v3/projects/168f119c0c9b47429e3ed26a7eabda5b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:52:15.430626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:15.440946 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a23aba-4c42-483c-a57e-f20f18c9d1dd service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:15.496310 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:15.497166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:15.497476 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:15.497755 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] PATH_INFO: `/v3/users/4ae079fc9ff1416f9adb37a39541d31b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:15.498911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae079fc9ff1416f9adb37a39541d31b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:15.500839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:15.547676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae079fc9ff1416f9adb37a39541d31b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.548330 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae079fc9ff1416f9adb37a39541d31b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.559791 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae079fc9ff1416f9adb37a39541d31b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.567070 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae079fc9ff1416f9adb37a39541d31b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.574156 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7d7f5b9b-4adb-4133-88ee-a92c29d0cb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae079fc9ff1416f9adb37a39541d31b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.580040 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1435/2830] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:52:15 2022] DELETE /identity/v3/users/4ae079fc9ff1416f9adb37a39541d31b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:52:15.848911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:15.850535 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:15.863970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe309d-3756-4517-a3ba-0b9667df428f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:15.922917 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:15.923908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:15.924188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:15.924464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] PATH_INFO: `/v3/projects/2a46f301823f4c06a6a1e9839c420a86` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:15.925683 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a46f301823f4c06a6a1e9839c420a86)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:15.927590 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:15.929026 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:15.976428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a46f301823f4c06a6a1e9839c420a86', 'request_id': 'req-5cefca9d-ca91-43b4-94cb-76d4d6452818'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.982968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a46f301823f4c06a6a1e9839c420a86', 'request_id': 'req-5cefca9d-ca91-43b4-94cb-76d4d6452818'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.988510 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a46f301823f4c06a6a1e9839c420a86', 'request_id': 'req-5cefca9d-ca91-43b4-94cb-76d4d6452818'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:15.999144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] The token cache is being invalidate because project 2a46f301823f4c06a6a1e9839c420a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:52:15.999428 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:16.000062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5cefca9d-ca91-43b4-94cb-76d4d6452818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:52:16.002139 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1396/2831] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:52:15 2022] DELETE /identity/v3/projects/2a46f301823f4c06a6a1e9839c420a86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:52:16.007251 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.007536 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.007812 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.025704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:52:16.026889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:16.031971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:16.087594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1436/2832] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:52:16.095866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.096105 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.096390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.114983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:52:16.116189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:16.124070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1397/2833] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:52:16.129146 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.138966 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526ada-9f3f-4f4b-90b6-68d4c1ac470e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.144219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.144858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.145135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.145436 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.146176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:52:16.146503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.148084 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.159376 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1437/2834] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:52:16.163506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.172615 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aa6bb-09ff-4497-94c9-24292d752749 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.177224 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.177892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.178173 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.178441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.179127 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.181006 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.208924 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1398/2835] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:52:16.213030 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.223688 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126b5-789e-495c-9a2d-5f4482505607 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.280978 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.281671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.281959 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.282241 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.283029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.285056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.304431 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1438/2836] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:52:16.308507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.319857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1786d6-34eb-4140-9b98-4661e9ea766d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.324709 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.325394 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.325679 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.325976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.326712 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.328314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.339587 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1399/2837] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:52:16.343484 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.353487 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f188-1b57-4739-babb-f53ba772ac6f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.358022 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.358664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.358947 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.359225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.359944 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.361662 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0aa55-4c3c-4f60-96e0-55b3f844486e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.371672 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1439/2838] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:52:16.375681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.386477 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b689a6-c18c-404f-b857-a0f7627fe321 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.391368 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.392359 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.392648 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.392928 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] PATH_INFO: `/v3/projects/db6cf1ef592b48e4b02c5b0897811256/users/b9d97bc77dc84355b330f087bc812a9f/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.407585 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6cf1ef592b48e4b02c5b0897811256, user_id=b9d97bc77dc84355b330f087bc812a9f, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.410584 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.423943 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1400/2839] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:52:16 2022] PUT /identity/v3/projects/db6cf1ef592b48e4b02c5b0897811256/users/b9d97bc77dc84355b330f087bc812a9f/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:52:16.435261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.435759 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.435878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.462560 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] MFA Rules not processed for user `b9d97bc77dc84355b330f087bc812a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:52:16.463770 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:16.527753 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1440/2840] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:52:16.532144 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.592418 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866bf6-4d1c-4e6e-9623-01c531580538 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.597094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.597765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.598046 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.598320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.599037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.600915 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.626380 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1401/2841] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:52:16.630788 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.641657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9b2f5-b104-4817-9c21-1a81f6c79dc2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.645165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:16.699522 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.700179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.700480 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.700800 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.701513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.703420 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.723118 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1441/2842] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:52:16.727094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.737675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e780-761c-48f7-8624-cccd9418d5bb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.742213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.742857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.743138 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.743412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.744125 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.745742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.750855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:16.758189 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1402/2843] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:52:16.762291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.772094 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b201-bb49-47b2-95a9-0b1e8c2f461f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.776607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.777505 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.777787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.778061 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] PATH_INFO: `/v3/projects/d08d8c6807844cf788354076f9da8db9/users/aa74623e02544c0ba08007a768268ae6/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.792862 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08d8c6807844cf788354076f9da8db9, user_id=aa74623e02544c0ba08007a768268ae6, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.795550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.808538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1442/2844] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:52:16 2022] PUT /identity/v3/projects/d08d8c6807844cf788354076f9da8db9/users/aa74623e02544c0ba08007a768268ae6/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:52:16.812607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.823518 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae599d-d69f-4f0c-9e3a-2c29aa0a852a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.880423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.881081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.881363 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.881671 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.882386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.883971 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f078655-de9d-46c0-a37e-1ebedac2e281 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.893842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1403/2845] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:52:16.897882 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:52:16.909418 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd9d7-7821-4551-8708-7b8aa6d43cae admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:52:16.914110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:52:16.915005 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.915291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.915566 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] PATH_INFO: `/v3/projects/d08d8c6807844cf788354076f9da8db9/users/aa74623e02544c0ba08007a768268ae6/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.917551 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08d8c6807844cf788354076f9da8db9, user_id=aa74623e02544c0ba08007a768268ae6, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:52:16.920170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:52:16.931262 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1443/2846] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:52:16 2022] PUT /identity/v3/projects/d08d8c6807844cf788354076f9da8db9/users/aa74623e02544c0ba08007a768268ae6/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:52:16.941558 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:52:16.941852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:52:16.942134 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:52:16.967676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] MFA Rules not processed for user `aa74623e02544c0ba08007a768268ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:52:16.968881 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:52:17.036055 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1404/2847] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:52:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:52:26.927391 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=41,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:52:27.032496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=63 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:01.794234 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:01.795670 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:01.867012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63aeaa-115d-46ec-adf0-b39bfc148624 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:01.870600 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:01.871238 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:01.871521 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:01.871795 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:01.880589 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:01.882052 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:01.891614 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1444/2848] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:53:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:53:02.097852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:02.107642 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855466bb-2664-4d23-b68d-f13f69f04c64 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:02.111831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:02.112482 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:02.112764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:02.113041 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:02.174438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:02.176043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a5bce-bfee-48e8-8f39-1e3d64693aef service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:02.186029 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1405/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:53:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:53:02.441273 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:02.503612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60e6-8441-4aa9-82e2-f545d0362abd service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:02.508166 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:02.509025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:02.509298 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:02.509602 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] PATH_INFO: `/v3/users/b9d97bc77dc84355b330f087bc812a9f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:02.511037 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d97bc77dc84355b330f087bc812a9f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:02.512954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:02.560055 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d97bc77dc84355b330f087bc812a9f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:02.560705 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d97bc77dc84355b330f087bc812a9f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:02.573015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d97bc77dc84355b330f087bc812a9f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:02.580069 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d97bc77dc84355b330f087bc812a9f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:02.587260 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d97bc77dc84355b330f087bc812a9f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:02.593115 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1445/2850] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:53:02 2022] DELETE /identity/v3/users/b9d97bc77dc84355b330f087bc812a9f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:53:02.598705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:02.598993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:02.599280 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:02.617852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:53:02.619058 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:02.677953 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1406/2851] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:53:02.687494 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:02.688878 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:02.702309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:02.749136 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e00893-d7cb-4f0e-8763-5d44973be961 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:02.753110 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:02.753885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:02.754108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:02.758284 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:02.768819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:02.770296 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:02.779910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1446/2852] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:53:03.048390 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.049908 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:03.062207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699e79-ec10-4c3a-bc9b-cd39f4823481 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:03.067236 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:03.068128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.068556 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.068949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] PATH_INFO: `/v3/projects/db6cf1ef592b48e4b02c5b0897811256` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.070183 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6cf1ef592b48e4b02c5b0897811256)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:03.072101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:03.121034 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6cf1ef592b48e4b02c5b0897811256', 'request_id': 'req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.128505 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6cf1ef592b48e4b02c5b0897811256', 'request_id': 'req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.134238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6cf1ef592b48e4b02c5b0897811256', 'request_id': 'req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.145975 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] The token cache is being invalidate because project db6cf1ef592b48e4b02c5b0897811256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:53:03.146268 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.146900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.148782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1407/2853] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:53:03 2022] DELETE /identity/v3/projects/db6cf1ef592b48e4b02c5b0897811256 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:53:03.152895 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.163254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67894-da02-4c1f-86d3-0eead3017059 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:03.218452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:03.219314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.219599 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.219875 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] PATH_INFO: `/v3/users/aa74623e02544c0ba08007a768268ae6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.221792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa74623e02544c0ba08007a768268ae6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:03.223714 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:03.269213 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa74623e02544c0ba08007a768268ae6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.269884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa74623e02544c0ba08007a768268ae6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.281292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa74623e02544c0ba08007a768268ae6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.288015 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa74623e02544c0ba08007a768268ae6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.295108 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5e65241b-ef09-4abe-a469-18dbeb49ad0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa74623e02544c0ba08007a768268ae6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.301011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1447/2854] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:53:03 2022] DELETE /identity/v3/users/aa74623e02544c0ba08007a768268ae6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:53:03.567983 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.569520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:03.583651 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8644a1-b772-46b4-abcd-b056bdd3f3ef admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:03.603276 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:03.645176 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:03.646067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.646345 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.646622 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] PATH_INFO: `/v3/projects/d08d8c6807844cf788354076f9da8db9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.647853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08d8c6807844cf788354076f9da8db9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:03.649819 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:03.696068 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08d8c6807844cf788354076f9da8db9', 'request_id': 'req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.703199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08d8c6807844cf788354076f9da8db9', 'request_id': 'req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.708882 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08d8c6807844cf788354076f9da8db9', 'request_id': 'req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.719827 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] The token cache is being invalidate because project d08d8c6807844cf788354076f9da8db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:53:03.720171 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.720858 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a3f705b3-67e2-45fc-bc8c-62ebc6c01e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:53:03.722446 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1408/2855] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:53:03 2022] DELETE /identity/v3/projects/d08d8c6807844cf788354076f9da8db9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:53:03.727849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.728169 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.728446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.746277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:53:03.747623 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:03.776422 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:03.808910 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1448/2856] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:53:03.817208 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.817481 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.817767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.835900 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:53:03.837103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:03.847194 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1409/2857] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:53:03.851412 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.861760 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a8599-16cc-4cbd-8e52-8f72427866d6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:03.866193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:03.866846 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.867133 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.867413 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.868147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:53:03.868457 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:03.870314 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:03.883087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1449/2858] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:53:03.887507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.896851 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4568f-bb3e-43a6-a670-abca22a46f92 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:03.901511 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:03.902153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:03.902433 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:03.902705 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:03.903421 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:03.905344 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:03.933108 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1410/2859] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:53:03 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:53:03.937255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:03.947931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc0716-9ebb-4075-999f-8197164fa403 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:04.003403 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:04.004054 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.004336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.004628 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.005292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:04.007228 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:04.026847 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1450/2860] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:53:03 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:53:04.030853 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:04.041964 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dc2fd-752d-472e-aabe-9d31797132b3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:04.046554 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:04.047188 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.047471 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.047750 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.049857 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:04.051453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:04.061759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1411/2861] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:53:04.065641 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:04.075518 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0f36-d523-440a-a5fd-40f07d830ab6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:04.080280 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:04.080921 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.081202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.081509 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.082231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:04.083849 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0300e2-30be-4fc5-af31-780126d91210 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:04.093727 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1451/2862] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:53:04.098449 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:04.108373 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5a52-2307-4c04-bb1c-da034de10bd2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:04.113647 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:04.114515 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.114795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.115070 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] PATH_INFO: `/v3/projects/18960cd5bb3544f8ad1ffd2419022eb4/users/5df0c2df743e42709609e55fab51fbcb/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.130674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18960cd5bb3544f8ad1ffd2419022eb4, user_id=5df0c2df743e42709609e55fab51fbcb, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:04.133406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:04.148040 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1412/2863] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:53:04 2022] PUT /identity/v3/projects/18960cd5bb3544f8ad1ffd2419022eb4/users/5df0c2df743e42709609e55fab51fbcb/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:53:04.207606 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.208191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.208191 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.234211 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] MFA Rules not processed for user `5df0c2df743e42709609e55fab51fbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:53:04.235398 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:04.299498 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1452/2864] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:53:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:53:04.310081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:04.311873 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:04.368442 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:04.372523 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20143-563f-4ded-baf1-4414f6b304a4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:04.378595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:04.379249 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:04.379735 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:04.380293 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:04.389203 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:04.390668 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d19ae4-32c1-4624-9db2-eceb5e71eb59 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:04.401538 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1413/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:53:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:53:14.296292 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:14.396721 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:53:14.417540 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:53:14.427780 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be915ba-5a05-43c5-94ec-b40c62e2ae3a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:53:14.431410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:53:14.432048 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:53:14.432334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:53:14.432615 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:53:14.434419 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:53:14.506763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:53:14.508230 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:53:14.526430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1453/2866] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:53:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:53:24.523786 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=36 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:14.681027 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:14.681616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:14.681616 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:14.708793 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] MFA Rules not processed for user `0a38dccab9404882be501aeb64a228f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:14.710061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:14.718204 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1414/2867] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:14.761694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:14.761694 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:14.842774 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8e7c-79c0-4842-becf-6d9125da9a7d service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:14.847466 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:14.848254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:14.848582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:14.848863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:14.850637 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:14.928276 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:14.929785 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:14.941029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1454/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:15.144491 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:15.145883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:15.205778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d607b3-2050-4147-b3c2-e43e72a7e77b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:15.209692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:15.210475 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:15.210766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:15.211160 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:15.212962 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:15.223374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:15.224960 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:15.234103 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1415/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:15.576137 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:15.578483 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:15.580716 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:15.586591 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919a3a-f63d-4781-8fda-de82a9866adc service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:15.590261 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:15.590964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:15.591269 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:15.591541 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:15.593282 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:15.608501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:15.610072 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:15.623107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1455/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:15.655680 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7330e9-4ee1-41e0-99b9-74f0382908bd service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:15.662320 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:15.663008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:15.663341 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:15.663612 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:15.665557 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:15.682190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:15.682190 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:15.693166 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1416/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:54:17.486609 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:17.495353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219a625-e0b3-4a6a-b487-53e9bb7b9918 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:17.498903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:17.499534 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:17.499819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:17.500099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:17.502210 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:17.512206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:17.513660 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:17.522483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1456/2872] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:18.234094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:18.236468 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:18.257037 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770d34d-5702-4c01-9a59-81c579fb398b service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:18.263729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:18.264561 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:18.264843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:18.265128 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:18.267053 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:18.280771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:18.282796 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80a1b-fb31-4324-851d-52611c2ad7a0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:18.297146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1417/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:19.768781 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:19.827863 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:19.834626 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b8dd9-b794-4d90-bdc2-ead43516afd6 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:19.839077 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:19.839931 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:19.840204 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:19.840473 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] PATH_INFO: `/v3/users/5df0c2df743e42709609e55fab51fbcb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:19.841680 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df0c2df743e42709609e55fab51fbcb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:19.843922 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:19.889749 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df0c2df743e42709609e55fab51fbcb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:19.890388 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df0c2df743e42709609e55fab51fbcb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:19.902664 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df0c2df743e42709609e55fab51fbcb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:19.910091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df0c2df743e42709609e55fab51fbcb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:19.917172 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df0c2df743e42709609e55fab51fbcb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:19.923964 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1457/2874] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:54:19 2022] DELETE /identity/v3/users/5df0c2df743e42709609e55fab51fbcb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:19.929004 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:19.929533 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:19.929645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:19.947023 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:19.948245 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:20.006386 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1418/2875] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:20.016104 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.018025 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:20.075665 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bc920-66a1-40ce-b775-8ac079e57d52 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.079885 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.080542 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.080819 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.081093 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.090312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.091740 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0033f-0e63-4d1f-9c41-f453e7fd8894 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.102255 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1458/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:20.371439 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.373135 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:20.390181 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1c32-babb-4d9b-86ab-fb611694a105 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.396912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.397809 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.398087 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.398356 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] PATH_INFO: `/v3/projects/18960cd5bb3544f8ad1ffd2419022eb4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.399540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18960cd5bb3544f8ad1ffd2419022eb4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.401461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.403162 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:20.452077 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18960cd5bb3544f8ad1ffd2419022eb4', 'request_id': 'req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:20.459391 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18960cd5bb3544f8ad1ffd2419022eb4', 'request_id': 'req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:20.464961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18960cd5bb3544f8ad1ffd2419022eb4', 'request_id': 'req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:20.476530 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] The token cache is being invalidate because project 18960cd5bb3544f8ad1ffd2419022eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:54:20.476840 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:20.477522 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ca3bf2cb-0ce3-421a-b2a7-1aac2ca8de38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:20.479089 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1419/2877] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:54:20 2022] DELETE /identity/v3/projects/18960cd5bb3544f8ad1ffd2419022eb4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:20.483961 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.484245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.484537 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.502441 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:20.503650 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:20.563303 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1459/2878] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:20.571595 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.571878 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.572152 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.590050 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:20.591243 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:20.598987 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1420/2879] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:20.603378 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.613663 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19af93-48c2-427e-97c5-1e249ba1a00e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.618245 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.618891 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.619173 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.619450 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.620168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:54:20.620479 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.622128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.638808 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1460/2880] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:54:20.639883 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.649842 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef09b7-a70f-4de9-908a-2a80baa4844e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.654564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.655210 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.655493 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.655771 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.656461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.659200 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.687392 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1421/2881] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:54:20 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:54:20.689176 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.697971 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:20.701777 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94c009-b6ad-43e0-a8f3-27151f3c598e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.762164 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.762839 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.763120 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.763396 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.764076 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.766029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.788687 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1461/2882] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:54:20 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:54:20.791571 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.802977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14e457-5e02-4717-8413-7c58e670294b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.807731 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.808400 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.808681 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.808965 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.809825 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.811604 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.823531 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1422/2883] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:54:20.827334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.837993 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a7fb-a2a5-4aa7-97f7-8fa6d3f0b21b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.842706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.843360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.843651 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.843935 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.844655 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.846883 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d459a-f284-401f-aef3-c8c0a76bcb74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.856927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1462/2884] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:54:20.861059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:20.870984 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacba4b-60e2-40e7-894b-90623dab256b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:20.875684 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:20.877628 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.877911 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.878192 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] PATH_INFO: `/v3/projects/51931e260aae426b93a7868048b03f55/users/269859b4844d4e8bb44315064eb4af77/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.894294 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51931e260aae426b93a7868048b03f55, user_id=269859b4844d4e8bb44315064eb4af77, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:20.896934 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:20.910930 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1423/2885] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:54:20 2022] PUT /identity/v3/projects/51931e260aae426b93a7868048b03f55/users/269859b4844d4e8bb44315064eb4af77/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:20.923165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa2c-7e2f-41be-80bf-37bd93fbd29d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:20.923382 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa2c-7e2f-41be-80bf-37bd93fbd29d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:20.923713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5aa2c-7e2f-41be-80bf-37bd93fbd29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:20.950730 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a5d5aa2c-7e2f-41be-80bf-37bd93fbd29d None None] MFA Rules not processed for user `269859b4844d4e8bb44315064eb4af77`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:20.952087 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a5d5aa2c-7e2f-41be-80bf-37bd93fbd29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:21.017617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1463/2886] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:21.028560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:21.030399 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:21.092315 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0e94-4d7b-441c-b322-b6ee01a15d06 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:21.096946 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819e7ece10414befa043f4b84da6c1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:21.097627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:21.097910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:21.098186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:21.106795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:21.108220 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:21.117973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1424/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:22.472464 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:22.472987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:22.473704 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:22.491469 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] MFA Rules not processed for user `269859b4844d4e8bb44315064eb4af77`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:22.492676 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:22.499630 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1464/2888] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:24.417008 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:24.419061 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:24.454258 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:24.501689 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549c9f-fcc4-4dfa-8326-415eb1d30d97 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:24.507560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:24.508206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:24.508488 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:24.508767 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:24.510871 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:24.523306 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:24.524875 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f5f9-54f5-4665-9d51-45b82f8c6223 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:24.535752 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1425/2889] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:32.485629 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:34.530899 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=21 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:50.171162 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:50.187239 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545133-b3f8-4148-9792-fab17ec2ba53 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:50.194386 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115ba46eabce4863a597ad69bca1703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:50.195352 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:50.195828 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:50.196285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:50.198389 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:50.212564 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:50.214285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:50.227513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1465/2890] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:52.412949 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a1b-72fd-4cc0-8ebd-5ba806f7d9a8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:52.413528 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a1b-72fd-4cc0-8ebd-5ba806f7d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:52.413990 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a1b-72fd-4cc0-8ebd-5ba806f7d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:52.476463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-10670a1b-72fd-4cc0-8ebd-5ba806f7d9a8 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:52.477703 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-10670a1b-72fd-4cc0-8ebd-5ba806f7d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:52.542153 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1426/2891] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:54:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:52.587851 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:52.589307 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:52.676285 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa932367-0385-4178-9e7e-9375eaa4ea20 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:52.681816 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:52.682452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:52.682735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:52.683011 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:52.690852 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:52.692996 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:52.701013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1466/2892] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:54:53.243114 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87f443-3404-4887-b088-ba3de2467287 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:53.243408 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87f443-3404-4887-b088-ba3de2467287 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:53.243692 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87f443-3404-4887-b088-ba3de2467287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:53.265974 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3b87f443-3404-4887-b088-ba3de2467287 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:53.267600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b87f443-3404-4887-b088-ba3de2467287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:53.278146 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1427/2893] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jun 20 06:54:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:53.292592 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:53.304101 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f17d-4160-4a2e-afe3-f11d774e81ba service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:53.309927 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:53.310938 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:53.311402 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:53.311843 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:53.321605 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:53.332128 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:53.343309 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1467/2894] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:54:53.575950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263c5c-6a87-4bfc-9e17-6226736e07c8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:53.576463 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263c5c-6a87-4bfc-9e17-6226736e07c8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:53.576575 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263c5c-6a87-4bfc-9e17-6226736e07c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:53.596939 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-62263c5c-6a87-4bfc-9e17-6226736e07c8 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:53.598264 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-62263c5c-6a87-4bfc-9e17-6226736e07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:53.607892 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1428/2895] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:54:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:53.620151 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:53.631538 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcad68-b6cd-462c-8511-0fd52fe897fa service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:53.636837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:53.637503 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:53.637790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:53.638079 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:53.647013 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:53.648657 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:53.657258 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1468/2896] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:54:54.002848 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:54.003133 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:54.003416 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:54.023250 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:54.024459 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:54.031920 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1429/2897] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jun 20 06:54:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:54.044459 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:54.058451 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d606f-cc85-465e-bb52-bf845ee10e40 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:54.064182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:54.064903 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:54.065194 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:54.065510 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:54.074912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:54.076472 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2317-89da-4db1-83f5-ae1746d4d527 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:54.085227 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1469/2898] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:54:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:54:56.198119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:56.268623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f3168-5f71-423a-a892-08b8d060abf1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:56.273973 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:56.274843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.275119 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.276012 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] PATH_INFO: `/v3/users/269859b4844d4e8bb44315064eb4af77` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.277218 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=269859b4844d4e8bb44315064eb4af77)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:56.279238 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:56.339562 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:56.341081 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269859b4844d4e8bb44315064eb4af77'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.341879 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269859b4844d4e8bb44315064eb4af77'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.350079 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269859b4844d4e8bb44315064eb4af77'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.357725 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269859b4844d4e8bb44315064eb4af77'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.358358 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269859b4844d4e8bb44315064eb4af77'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.376464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1430/2899] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:54:56 2022] DELETE /identity/v3/users/269859b4844d4e8bb44315064eb4af77 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:56.381553 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.382198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.382198 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.401160 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:56.402410 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:56.471095 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1470/2900] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:56.481366 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:56.482938 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:56.541782 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48d7e-8752-459a-8fe2-cfb7d5260f5b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:56.545765 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:56.546663 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.546948 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.547222 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.557630 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:56.559120 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea9324-e2b2-4c36-abf1-2ea8bcd8bdda service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:56.583565 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1431/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:54:56.751987 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:56.753559 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:56.767041 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0769-a102-4e81-a5c6-b2800799143e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:56.774648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:56.775526 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.775856 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.776360 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] PATH_INFO: `/v3/projects/51931e260aae426b93a7868048b03f55` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.778247 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51931e260aae426b93a7868048b03f55)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:56.780231 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:56.794869 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:56.831219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51931e260aae426b93a7868048b03f55', 'request_id': 'req-22f77496-b870-4969-ab04-3966843ce576'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.838012 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51931e260aae426b93a7868048b03f55', 'request_id': 'req-22f77496-b870-4969-ab04-3966843ce576'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.845026 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51931e260aae426b93a7868048b03f55', 'request_id': 'req-22f77496-b870-4969-ab04-3966843ce576'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.857988 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] The token cache is being invalidate because project 51931e260aae426b93a7868048b03f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:54:56.858277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.858911 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-22f77496-b870-4969-ab04-3966843ce576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:54:56.860446 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1471/2902] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:54:56 2022] DELETE /identity/v3/projects/51931e260aae426b93a7868048b03f55 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:56.866035 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.866325 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.866607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.884199 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:56.885695 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:56.944150 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1432/2903] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:56.951631 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:56.951919 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:56.952202 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:56.970833 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:56.972047 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:56.980594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1472/2904] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:56.984828 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:56.995808 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff66590-50fa-415f-8a9e-529c83a5faf9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.000454 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.001106 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.001403 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.001697 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.002422 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:54:57.002729 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.004321 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.016507 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1433/2905] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jun 20 06:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:54:57.020712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.030143 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa6c7-96e6-4978-b903-848882f3ae4e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.034779 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.035426 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.035712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.036890 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.037281 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.039218 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.066148 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1473/2906] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:54:57 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:54:57.070730 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.082478 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e94af-086d-49e0-88e5-d9e5717c6a9b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.137417 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:57.148916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.149618 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.149902 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.150180 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.150869 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.152789 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.171621 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1434/2907] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:54:57 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:54:57.175632 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.186582 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13b6c-3820-4b7c-92f1-fc9ad02850c3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.191265 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.191914 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.192818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.193099 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.193977 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.195594 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.206860 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1474/2908] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:54:57.210797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.221811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fdc-f645-418f-9c07-1b5fc80c5105 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.227091 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.227749 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.228059 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.228374 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.229084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.230843 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d73934-a6ce-47fd-9fc5-6a43b5112c3e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.241589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1435/2909] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:54:57.245706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.256254 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778b3b1-f3c0-4460-b3dd-403df86c76d6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.261677 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.262547 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.262824 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.263096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] PATH_INFO: `/v3/projects/2aac1f56c3944004b44f10b5cb8c078f/users/9ae5657265bc4f3aa8a6a7dfe6a257dc/roles/304a10ad50ff4fad86a065396035066f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.277837 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aac1f56c3944004b44f10b5cb8c078f, user_id=9ae5657265bc4f3aa8a6a7dfe6a257dc, role_id=304a10ad50ff4fad86a065396035066f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.280513 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.293562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1475/2910] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:54:57 2022] PUT /identity/v3/projects/2aac1f56c3944004b44f10b5cb8c078f/users/9ae5657265bc4f3aa8a6a7dfe6a257dc/roles/304a10ad50ff4fad86a065396035066f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:54:57.298564 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f2e1-493a-422b-858c-e868ed797fd7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.298852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f2e1-493a-422b-858c-e868ed797fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.299129 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f2e1-493a-422b-858c-e868ed797fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.318506 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0906f2e1-493a-422b-858c-e868ed797fd7 None None] MFA Rules not processed for user `3192aad0e5c64158b978fa55eb9121d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:54:57.319639 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0906f2e1-493a-422b-858c-e868ed797fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:57.378675 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1436/2911] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:54:57.390206 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:54:57.391916 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:54:57.454107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa7b5-cd6f-4f76-a383-e6d4c2eb4355 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:54:57.457717 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:54:57.458430 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:54:57.458716 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:54:57.458990 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:54:57.468293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:54:57.469763 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:54:57.479822 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1476/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:55:01.767623 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:01.768747 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:01.769233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:01.811560 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] MFA Rules not processed for user `9ae5657265bc4f3aa8a6a7dfe6a257dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:55:01.812910 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:01.911084 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1437/2913] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:55:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:55:01.915338 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:01.925439 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9837b66-c05f-4063-94fd-3b1edfeb6151 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:01.931036 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:01.931941 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:01.932091 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:01.932246 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:01.932952 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:01.934896 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:01.997524 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1477/2914] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jun 20 06:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:55:02.001352 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.014877 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324b7b-5e5d-409f-a6d1-99e4882c1787 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.066915 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.094790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:02.119464 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.120155 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.120438 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.120715 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.121540 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.123412 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.132855 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:02.149546 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e222e-9032-41c0-847b-ae72ca8c9326 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.156720 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1438/2915] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jun 20 06:55:02 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:55:02.157580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.158482 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.158937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.159219 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.162174 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:02.162645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.174701 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42967-d8ec-44f9-bdab-7264ac012410 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.177447 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.179361 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.184297 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.185360 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.186017 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.186700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.187627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.190844 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.194598 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1478/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:55:02.210357 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1439/2917] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:55:02.213713 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.224790 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253540e-df4d-4757-b786-594ccabb9a74 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.232496 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.233718 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.234161 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.234616 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] PATH_INFO: `/v3/projects/d07e0f8452824058a9d455fdcb2320e5/users/318f244a27de4213958ea86cd413aa9d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.254689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07e0f8452824058a9d455fdcb2320e5, user_id=318f244a27de4213958ea86cd413aa9d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.257929 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.280587 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1479/2918] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:55:02 2022] PUT /identity/v3/projects/d07e0f8452824058a9d455fdcb2320e5/users/318f244a27de4213958ea86cd413aa9d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:02.284976 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.297242 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d5775-be1e-44c4-8487-b7f62b617332 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.397206 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.397785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.398069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.398508 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.399479 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.401961 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.419322 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1440/2919] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jun 20 06:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:55:02.425892 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:02.440787 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce6b2-cf48-48b8-8739-bc631524f599 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:02.450086 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:02.452113 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:02.452501 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:02.453056 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] PATH_INFO: `/v3/projects/d07e0f8452824058a9d455fdcb2320e5/users/318f244a27de4213958ea86cd413aa9d/roles/9db7cad99fca4e13a5d148271b26d46d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:02.455732 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07e0f8452824058a9d455fdcb2320e5, user_id=318f244a27de4213958ea86cd413aa9d, role_id=9db7cad99fca4e13a5d148271b26d46d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:02.461858 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b94820-cf6a-45c3-b021-bc9f623af95d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:02.474613 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1480/2920] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jun 20 06:55:02 2022] PUT /identity/v3/projects/d07e0f8452824058a9d455fdcb2320e5/users/318f244a27de4213958ea86cd413aa9d/roles/9db7cad99fca4e13a5d148271b26d46d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:07.174700 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:07.181024 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:07.626601 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788aa0-4a87-4278-96a9-14ae161ef275 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:07.792954 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:07.793813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:07.794094 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:07.794367 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:07.799889 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:07.843866 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:07.848051 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:07.881992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1441/2921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:55:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:55:08.615686 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804db88-8180-4e0f-b263-e595ede4052f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:08.616135 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804db88-8180-4e0f-b263-e595ede4052f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:08.616294 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804db88-8180-4e0f-b263-e595ede4052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:08.647899 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f804db88-8180-4e0f-b263-e595ede4052f None None] MFA Rules not processed for user `318f244a27de4213958ea86cd413aa9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:55:08.649519 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f804db88-8180-4e0f-b263-e595ede4052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:08.780617 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1481/2922] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jun 20 06:55:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:55:08.798977 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:08.802970 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:08.822870 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:08.896423 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442562-b16c-47e5-885a-4c6cdde46b77 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:08.902207 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bee578760b649d7a8fc07d5e9770746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:08.904052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:08.904052 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:08.904240 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:08.976213 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:08.977526 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:08.990573 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1442/2923] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:55:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:55:09.110312 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:09.110698 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:09.111043 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:09.131898 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:55:09.133126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:09.232699 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1482/2924] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jun 20 06:55:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:55:09.248823 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:09.255251 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:09.366792 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de1a9f-8d01-48d4-a07a-5969e07fd88c service glance] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:09.372912 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:09.374635 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:09.375015 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:09.375401 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:09.386140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:09.388343 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:09.416233 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1443/2925] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:55:11.884126 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:11.887029 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:11.913706 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:11.981671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f854b-94af-485d-a3c4-54f397db851a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:11.986370 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:11.987353 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:11.987712 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:11.988066 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] PATH_INFO: `/v3/users/6f577abe1ada45979d5cb550073ae6a8` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:11.990257 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f577abe1ada45979d5cb550073ae6a8)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:11.992271 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:12.047980 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f577abe1ada45979d5cb550073ae6a8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.048647 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f577abe1ada45979d5cb550073ae6a8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.062735 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f577abe1ada45979d5cb550073ae6a8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.075463 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f577abe1ada45979d5cb550073ae6a8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.088147 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f577abe1ada45979d5cb550073ae6a8'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.098235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1483/2926] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:55:11 2022] DELETE /identity/v3/users/6f577abe1ada45979d5cb550073ae6a8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:12.323921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:12.339140 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461174de-c45e-4993-adc9-9fb271c1a50c service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:12.399991 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:12.409992 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:12.411143 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:12.412101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:12.412476 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] PATH_INFO: `/v3/projects/a80966bf28184a9f8e9987632f7c0973` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:12.414025 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80966bf28184a9f8e9987632f7c0973)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:12.416265 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:12.477148 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80966bf28184a9f8e9987632f7c0973', 'request_id': 'req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.494231 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80966bf28184a9f8e9987632f7c0973', 'request_id': 'req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.501795 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80966bf28184a9f8e9987632f7c0973', 'request_id': 'req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.529254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] The token cache is being invalidate because project a80966bf28184a9f8e9987632f7c0973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:55:12.529674 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.537021 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.539295 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1444/2927] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:55:12 2022] DELETE /identity/v3/projects/a80966bf28184a9f8e9987632f7c0973 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:12.543182 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:12.545580 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:12.568096 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589569-65c2-46b6-8517-91a517db236c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:12.643428 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:12.644954 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:12.645334 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:12.646291 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] PATH_INFO: `/v3/users/cf67960aef8b4140b8c0381f253b5540` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:12.665809 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf67960aef8b4140b8c0381f253b5540)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:12.667872 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:12.696654 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:12.730062 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf67960aef8b4140b8c0381f253b5540'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.730797 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf67960aef8b4140b8c0381f253b5540'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.747336 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf67960aef8b4140b8c0381f253b5540'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.754373 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf67960aef8b4140b8c0381f253b5540'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.765937 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf67960aef8b4140b8c0381f253b5540'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:12.773220 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1484/2928] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:55:12 2022] DELETE /identity/v3/users/cf67960aef8b4140b8c0381f253b5540 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:13.039330 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:13.040916 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:13.093581 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b48d-f69a-47d1-9a58-7d1b6dfd44f3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:13.174589 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:13.175419 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:13.175761 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:13.176179 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] PATH_INFO: `/v3/projects/cb322becb7d24d509d6ec15921e6e3c3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:13.188824 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb322becb7d24d509d6ec15921e6e3c3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:13.190884 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:13.294968 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb322becb7d24d509d6ec15921e6e3c3', 'request_id': 'req-14b3d115-48d8-4113-b9fb-687e8b4dca08'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:13.306811 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb322becb7d24d509d6ec15921e6e3c3', 'request_id': 'req-14b3d115-48d8-4113-b9fb-687e8b4dca08'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:13.318607 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb322becb7d24d509d6ec15921e6e3c3', 'request_id': 'req-14b3d115-48d8-4113-b9fb-687e8b4dca08'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:13.340592 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] The token cache is being invalidate because project cb322becb7d24d509d6ec15921e6e3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:55:13.341202 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:13.341766 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:13.349989 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1445/2929] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:55:13 2022] DELETE /identity/v3/projects/cb322becb7d24d509d6ec15921e6e3c3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:22.768568 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:23.336314 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:26.140153 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:26.141581 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:26.199369 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703a33-8521-4b9d-9cd3-fc8805d2641c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:26.246633 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de74d94d77fd4220a976184b587f389e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:26.247277 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:26.247562 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:26.247842 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:26.249667 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:26.313845 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:26.315339 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:26.326163 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1485/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:55:26.831376 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:26.833118 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:55:26.846223 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d115-48d8-4113-b9fb-687e8b4dca08 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:26.852186 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:26.853361 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:26.853797 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:26.854252 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] PATH_INFO: `/v3/users/0a38dccab9404882be501aeb64a228f6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:26.855759 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a38dccab9404882be501aeb64a228f6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:26.857940 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:26.904196 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a38dccab9404882be501aeb64a228f6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:26.904836 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a38dccab9404882be501aeb64a228f6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:26.911897 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a38dccab9404882be501aeb64a228f6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:26.919993 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a38dccab9404882be501aeb64a228f6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:26.920602 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a38dccab9404882be501aeb64a228f6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:26.938272 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1446/2931] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:55:26 2022] DELETE /identity/v3/users/0a38dccab9404882be501aeb64a228f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:27.111468 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:55:27.123179 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3b1c-c359-45b7-a1c0-d988f48f4132 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:55:27.179799 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:55:27.180666 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:55:27.180948 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:55:27.181225 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] PATH_INFO: `/v3/projects/ef4cdcfeeefd4d598f28a1316087944f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:55:27.182452 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4cdcfeeefd4d598f28a1316087944f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:55:27.185107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:55:27.196340 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:27.235889 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4cdcfeeefd4d598f28a1316087944f', 'request_id': 'req-c5a23e14-048c-493d-862e-3cf563c81d08'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:27.241544 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4cdcfeeefd4d598f28a1316087944f', 'request_id': 'req-c5a23e14-048c-493d-862e-3cf563c81d08'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:27.247235 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4cdcfeeefd4d598f28a1316087944f', 'request_id': 'req-c5a23e14-048c-493d-862e-3cf563c81d08'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:27.259761 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] The token cache is being invalidate because project ef4cdcfeeefd4d598f28a1316087944f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:55:27.260168 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:27.260792 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c5a23e14-048c-493d-862e-3cf563c81d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:55:27.262610 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1486/2932] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:55:27 2022] DELETE /identity/v3/projects/ef4cdcfeeefd4d598f28a1316087944f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:55:36.934774 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:37.256237 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:56:01.864580 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:01.866007 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:01.984448 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6364ab-552a-4749-9f1c-8e2d51cbb877 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:02.041852 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:02.042486 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:02.042764 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:02.043062 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:02.045337 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:02.056101 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:02.057687 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:02.067831 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1447/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 06:56:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:56:12.063742 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=80 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:56:19.634362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:19.634818 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:19.634912 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:19.663183 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] MFA Rules not processed for user `486089870c21413b8618845b3217da76`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:56:19.664357 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:19.724877 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1487/2934] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jun 20 06:56:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:56:19.771069 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:19.772496 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:19.856625 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092172b-0b29-490b-b308-b8eec5b4a7aa service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:19.862009 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573c370fec404be39c9a21fbafd43a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:19.862600 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:19.862891 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:19.863174 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:19.871350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:19.872936 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:19.881988 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1448/2935] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jun 20 06:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:56:25.964764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:25.966638 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:26.048021 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a661-ed3f-4c5b-a225-4406f6f2c90d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:26.052448 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:26.053354 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:26.053671 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:26.053945 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] PATH_INFO: `/v3/users/9ae5657265bc4f3aa8a6a7dfe6a257dc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:26.055165 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae5657265bc4f3aa8a6a7dfe6a257dc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:26.057107 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:26.114193 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae5657265bc4f3aa8a6a7dfe6a257dc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.114864 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae5657265bc4f3aa8a6a7dfe6a257dc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.127550 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae5657265bc4f3aa8a6a7dfe6a257dc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.134293 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae5657265bc4f3aa8a6a7dfe6a257dc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.141611 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae5657265bc4f3aa8a6a7dfe6a257dc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.147936 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1488/2936] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:56:25 2022] DELETE /identity/v3/users/9ae5657265bc4f3aa8a6a7dfe6a257dc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:56:26.320645 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:26.331676 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db1d5-2f8a-4157-add5-e51cf4e2df3a service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:26.393151 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:26.394067 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:26.394350 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:26.394627 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] PATH_INFO: `/v3/projects/2aac1f56c3944004b44f10b5cb8c078f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:26.395816 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aac1f56c3944004b44f10b5cb8c078f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:26.397778 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:26.442239 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aac1f56c3944004b44f10b5cb8c078f', 'request_id': 'req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.449950 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aac1f56c3944004b44f10b5cb8c078f', 'request_id': 'req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.456113 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aac1f56c3944004b44f10b5cb8c078f', 'request_id': 'req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.467111 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] The token cache is being invalidate because project 2aac1f56c3944004b44f10b5cb8c078f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:56:26.467406 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.468085 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.469815 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1449/2937] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:56:26 2022] DELETE /identity/v3/projects/2aac1f56c3944004b44f10b5cb8c078f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:56:26.474027 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:26.475411 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:26.488186 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b60d3-dd2a-4bd1-b6ea-e0a10e435ab4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:26.492648 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:56:26.544681 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:26.545483 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:26.545764 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:26.546035 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] PATH_INFO: `/v3/users/318f244a27de4213958ea86cd413aa9d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:26.547407 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318f244a27de4213958ea86cd413aa9d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:26.549318 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:26.594458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318f244a27de4213958ea86cd413aa9d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.595085 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318f244a27de4213958ea86cd413aa9d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.606893 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318f244a27de4213958ea86cd413aa9d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.614175 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318f244a27de4213958ea86cd413aa9d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.621170 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318f244a27de4213958ea86cd413aa9d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.627607 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1489/2938] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jun 20 06:56:26 2022] DELETE /identity/v3/users/318f244a27de4213958ea86cd413aa9d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:56:26.802833 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:56:26.804372 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:56:26.814429 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:56:26.818813 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782a8d-c6b2-4f73-98f6-fa5e3c91a83c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:56:26.881923 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169844e-f649-447e-adad-707500d6152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3192aad0e5c64158b978fa55eb9121d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9a6bdb9ae7447fb41cd2764e1194d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:56:26.882785 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169844e-f649-447e-adad-707500d6152a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:56:26.883064 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169844e-f649-447e-adad-707500d6152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:56:26.883340 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169844e-f649-447e-adad-707500d6152a admin admin] PATH_INFO: `/v3/projects/d07e0f8452824058a9d455fdcb2320e5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:56:26.884520 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169844e-f649-447e-adad-707500d6152a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07e0f8452824058a9d455fdcb2320e5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:56:26.886461 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169844e-f649-447e-adad-707500d6152a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:56:26.932450 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07e0f8452824058a9d455fdcb2320e5', 'request_id': 'req-e169844e-f649-447e-adad-707500d6152a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.940441 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07e0f8452824058a9d455fdcb2320e5', 'request_id': 'req-e169844e-f649-447e-adad-707500d6152a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.946291 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07e0f8452824058a9d455fdcb2320e5', 'request_id': 'req-e169844e-f649-447e-adad-707500d6152a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.956956 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] The token cache is being invalidate because project d07e0f8452824058a9d455fdcb2320e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:56:26.957254 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.957921 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e169844e-f649-447e-adad-707500d6152a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:56:26.959453 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1450/2939] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jun 20 06:56:26 2022] DELETE /identity/v3/projects/d07e0f8452824058a9d455fdcb2320e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:56:36.623653 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:56:36.954043 dv-cinder-804735-31-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:01:05.874906 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 07:01:05.876320 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 07:01:05.952515 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82188cd6-3306-46c0-9bc1-70ff02d69689 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 07:01:06.009689 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a2e4c690694f1b8cf0ced06d7715ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5cf63b5c6674e939c3268ef8fdc313e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 07:01:06.010331 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 07:01:06.010612 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 07:01:06.010884 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 07:01:06.012669 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 07:01:06.023783 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 07:01:06.025362 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69d580-5755-408c-8344-3c2fd5a9e8f2 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 07:01:06.038545 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1490/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jun 20 07:01:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 07:01:16.032458 dv-cinder-804735-31-iscsi devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=60 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}